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FOREWORD 


This  publication  examines  10-year  trends  in  the  workload  and  actions  of  study  sections,  the  initial  review  groups  managed  by 
the  Division  of  Research  Grants,  in  the  context  of  an  ever-changing  research  climate.  It  reports  priority  scores,  percentile  rank- 
ings, the  final  success  of  apphcations,  and  the  characteristics  of  appHcants  and  applications.  Covering  1983  to  1992,  this  report 
includes  trends  resulting  from  recent  NIH  pohcy  decisions,  such  as  augmenting  the  duration  of  some  kinds  of  grants  and  estab- 
hshing  new  grant  categories.  While  the  initial  part  of  the  pubhcation  displays  statistics  on  a variety  of  grant  mechanisms,  its 
chief  focus  will  be  the  traditional,  investigator-initiated  research  project  (ROl ) reviewed  by  DRG. 

The  NIH  system  of  peer  review  organizes  panels  of  recognized  experts  to  evaluate  the  merit  of  biomedical  and  behavioral  sci- 
ence grant  applications.  The  evaluations  and  priority  ratings  of  these  initial  review  groups  are  the  most  significant  indices  of 
the  scientific  merit  of  apphcations  m the  NIH  review  process.  Subsequent  versions  of  this  volume  will  incorporate  data  for 
the  National  Institute  on  Alcohol  Abuse  and  AlcohoHsm  (NIAAA),  the  National  Institute  on  Drug  Abuse  (NIDA),  and  the  Na- 
tional Institute  of  Mental  Health  (NIMH). 

The  NIH  peer  review  system  adapts  to  changing  conditions  to  provide  a stable,  yet  flexible,  system  for  the  review  of  grant  ap- 
pHcations.  A large  number  of  appHcants  competing  for  a limited  number  of  research  grants  subject  both  appHcants  and  review- 
ers to  pressure.  In  addition  poHcy  changes  such  as  providing  appHcants  with  feedback,  expanding  the  rating  scale,  or  adopting 
percentiles  as  a primary  measurement  of  quahty  may  affect  peer  review  outcomes.  This  pubhcation  describes  how  such  changes 
relate  to  DRG  study  sections.  The  reader  is  cautioned,  however,  that  observed  changes  in  the  data  cannot  be  simply  attributed 
to  either  changes  in  the  quahty  of  the  apphcations  or  to  the  behavior  of  study  sections.  Rather,  the  basis  for  observed  changes 
might  be  due  to  some  complex,  nonobvious  sources. 

NIH  extramural  staff  re-examine  the  NIH  peer  review  system  constantly  for  potential  improvements.  These  studies  and  their 
results  are  included  in  PEER  REVIEW  TRENDS  from  time  to  time.  Suggestions  for  changes  and  additions  to  this  pubhcation 
are  welcome.  Please  direct  them  to  Wilham  E.  McGarvey,  Ph.D.,  who  has  the  principal  responsibihty  for  this  pubhcation.  Dr. 
McGarvey  can  be  reached  at  301/594-7328  (voice),  301/594-7394  (facsimile),  orQGM@DRGPO.DRG.NIH.GOV  (E-Mail).  Cor- 
respondence should  be  addressed  to  him  in  care  of  the  Statistical  Analysis  Unit,  Statistics,  Analysis,  and  Evaluation  Section, 
Information  Systems  Branch,  Division  of  Research  Grants,  National  Institutes  of  Health,  Bethesda,  Maryland  20892. 
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HIGHUGHTS 


The  number  of  competing  grant  applications  submitted  annually  for  NIH  review  increased  (by  7,137)  to  31,145  from  1983  to  1992, 
while  requested  dollar  support  increased  from  $2,3  bilHon  to  $4.8  billion.  The  majority  of  apphcations  in  1992  (54.1  percent)  were 
Traditional  Research  Projects  (ROl)  reviewed  by  DRG.  More  than  79  percent  of  all  apphcations,  or  24,708,  were  referred  to  DRG 
study  sections  for  review.  Individual  Institutes  and  Centers  are  reviewing  an  increasing  proportion  of  the  apphcations,  and  these  are 
much  more  diverse  than  those  reviewed  by  DRG.  (Pages  2-7)  (Unless  specificaUy  stated,  the  remaining  highhghts  refer  to  DRG- 
reviewed  competing  ROl  apphcations.) 


The  number  of  competing  amended  ROl  apphcations  continues  to  grow;  it  grew  by  more  than  51  percent  over  the  decade,  from  3,680 
to  5,576  (23.8  percent  to  35.5  percent).  (Pages  10-15) 


In  1990,  approval  rates  increased  to  over  95  percent,  with  a modal  outcome  of  approved,  but  not  funded  for  ROl  apphcations  (75.9 
percent  in  1990).  Partly  as  a result  of  this,  the  concept  of  disapproval  has  been  discarded  (effective  October  1991)  in  favor  of  a new 
and  re-defined  classification  of  "not  recommended  for  further  consideration"  (NRFC).  (Pages  16-19,  24f.) 


After  moving  toward  100  for  seven  years  and  then  reversing  that  trend  in  1989  with  the  advent  of  percentile  scores  and  standardized 
adjectives,  mean  ROl  priority  scores  have,  since  1990,  again  begun  to  exhibit  a "creep"  toward  100.  (Pages  22-33) 


Every  year,  ROl  apphcations  requesting  more  years  of  support  consistently  receive  better  scores  than  those  requesting  fewer  years  of 
support;  most  (49.6  percent)  ROl  apphcations  - excluding  amendments  - now  ask  for  5 or  more  years  of  support  In  1983,  59.6 
percent  of  ROl  apphcations  asked  for  only  3 years  of  support,  while  24.0  percent  asked  for  5 or  more  years  of  support.  (Pages  42-51) 


While  the  number  of  ROl  competing  grant  apphcations  assigned  to  different  Institutes  remained  remarkably  stable  over  the  decade, 
NIAID  experienced  the  largest  absolute  increase  (up  386  to  1,721).  NCI  had  the  largest  absolute  decrease  (down  373  to  2,508). 
(Pages  52-57) 


• ROl  applications  were  almost  three  times  more  likely  to  come  from  those  with  a Ph.D.  and  other  research  degrees  than  those  with 
an  M.D.  and  other  clinical  degrees.  Their  1992  mean  scores,  however,  differed  only  sHghtly.  (Pages  60-67) 


• Despite  the  availabihty  of  FIRST  (R29)  awards,  the  number  of  ROl  applications  from  the  yotmgest  researchers  has  continued  to  de- 
cline. Nonetheless,  young  researchers  do  receive  significantly  superior  priority  scores.  (Pages  68-73) 


• Since  1986,  mean  ROl  priority  scores  of  male  and  female  applicants  were  essentially  equivalent  Of  the  1992  apphcants,  18.7  percent 
were  female,  as  compared  with  14.8  percent  of  the  1983  apphcants.  (Pages  74-81) 


• Minority  investigators  submitted  13.7  percent  of  1992  ROl  grant  appHcations;  most  (10.6  percent  of  aU  ROl  apphcants)  were 
Asian/Pacific  Islanders.  (Pages  82-87) 


ROl  apphcations  from  Basic  Science  departments  were  consistently  rated  with  better  average  priority  scores  than  ROl  apphcations 
from  Clinical  Science  departments.  (Pages  96-99) 


IX 


TECHNICAL  NOTES 


1.  IMP  AC  (Information  for  Management,  Planning,  Analysis,  and  Coordination):  The  NIH  Division  of  Research  Grants’  computer-based 
system  for  information  about  PHS  extramural  programs,  and  the  primary  source  of  information  for  this  report. 

2.  FISCAL  YEAR:  Data  about  study  section  actions  (e.g.,  priority  scores  or  percentile  ranks)  in  this  report  are  compiled  primarily  by 
fiscal  year  of  initial  review  group  meeting.  This  includes  the  January,  May,  and  August/October  Council  meetings  of  the  indicated 
year;  prior  to  1978,  it  included  March  and  May/ June  meetings  of  the  indicated  year  plus  the  November  meetings  of  the  prior  calendar 
year.  Data  related  to  funding  of  appHcations  (e.g.,  success  rates)  are  compiled  for  the  funded  applications  by  fiscal  year  of  appropria- 
tion, and  for  unfunded  applications,  by  requested  start  date. 

3.  WORKLOAD  STATISTICS:  In  Section  1,  these  refer  to  applications  assigned  to  DRG  study  sections  for  review.  The  DRG  workload 
also  includes  receipt  and  referral  of  all  applications  to  both  DRG  and  Institute  review  panels.  Sections  2 to  7 refer  to  the  actions 
of  DRG  study  sections  (except  where  noted)  and  exclude  appHcations  that  were  either  withdrawn  by  appHcants  or  deferred  by  study 
section  action.  In  this  report,  an  appHcation  normaUy  includes  the  initial  appHcation  and  any  amendments  that  are  reviewed  in  the 
same  fiscal  year. 

4.  THE  CRITERIA  FOR  RESEARCH  PROJECT  REVIEW:  These  include  (a)  scientific  significance  and  originaHty;  (b)  research  design; 
(c)  qualifications  and  experience  of  the  principal  investigator  and  staff;  (d)  scientific  and  administrative  environment;  (e)  appropri- 
ateness of  the  budget;  and  (f)  adequacy  of  protection  for  humans,  animals,  or  environment,  where  appHcable. 

5.  REVIEW:  Effective  in  1992,  an  appHcation  designated  as  "reviewed"  has  either  received  a priority  score  or  has  been  labeled  "Not 
Recommended  for  Further  Consideration".  In  this  pubHcation,  appHcations  assigned  to  DRG  study  sections  for  review  but  subsequent- 
ly withdrawn  or  deferred  are  not  counted  as  reviewed. 

6.  STUDY  SECTION  ACTION:  An  appHcation  that  has  been  recommended  for  further  consideration  by  a DRG  study  section  is  considered 
of  sufficient  scientific  merit  to  be  worthy  of  support.  Therefore,  a study  section’s  action  is  a recommendation  that  an  award  be  made 
- provided  that  other  ICD  Advisory  Council  criteria  are  satisfied.  Tliis  recommendation  can  be  for  the  time  and  amount  requested 
or  for  an  adjusted  time  and  amount.  Study  sections  assign  a priority  rating  of  100  (highest  merit)  to  500  (lowest  merit)  to  each 
appHcation.  GeneraUy,  percentile  ranks  are  also  computed  based  upon  these  priority  scores.  These  ranks  are  intended  to  suggest 
relative  scientific  worth  to  the  Councils. 
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7.  DOCTORAL  DEGREES:  Among  the  cases  classified  as  an  M.D.  are  those  with  the  following  degrees:  M.D.,  B.M.,  M.B.,  B.M.D.,  Med. 
B.S.,  and  F.R.C.P.  Among  the  cases  classified  as  a Ph.D.  are  those  with  the  following  degrees:  Ph.D.,  Ed.D.,  D.Eng.,  D.Sc.,  Ed.D., 
Sc.D.,  D.PhQ.,  D.P.E.,  D.S.N.,  D.Phl.,  D.P.H.,  D.R.P.H.,  D.  Ed.,  D.N.S.,  D.N.Sc.,  D.S.W.,  and  Psy.D.  All  other  degrees  are  classified  as 
Other. 

8.  PRIORITY  SCORES:  These  show  a study  section’s  evaluation  of  the  relative  scientific  and  technical  merit  of  research  apphcations. 
Using  an  interval  of  0.1,  individual  members  assign  scores  from  1.0  (highest  merit)  to  5.0  (lowest  merit).  Under  laws  governing  NIH’s 
chartered  Advisory  Committees,  only  regular  members  or  members  of  the  NIH  Reviewers  Reserve  (not  ad  hoc  consultants)  are  permit- 
ted to  vote  on  apphcation  quahty.  Votes  were  cast  in  0.5  intervals  intermittently  until  1980.  Since  then,  in  order  to  achieve  more 
precise  scoring,  votes  have  been  cast  in  0.1  intervals.  The  raw  three-digit  priority  scores,  which  can  range  from  100  to  500,  are  the 
average  of  member  votes  multipHed  by  100. 

9.  NORMALIZED  SCORES:  In  addition  to  raw  scores,  these  were  calculated  from  November  1971  to  May  1980  in  an  effort  to  make 
priority  scores  of  the  different  study  sections  more  comparable.  These  normahzed  standard  scores  represented  the  mathematical  trans- 
formation of  raw  scores  to  a normal  distribution  having  an  overall  mean  of  250  and  a standard  deviation  of  70.  They  were  based 
on  each  study  section’s  priority  scores  for  all  approved  apphcations  from  the  study  section’s  last  three  meetings.  Some  Institutes  used 
normahzed  scores;  others  retained  the  raw  score  as  a primary  basis  for  funding  decisions.  The  use  of  normahzed  scores  was  discon- 
tinued in  1980  because  of  umesolved  problems  associated  with  their  use,  including  the  confusion  induced  by  double  scores  (actual 
and  normahzed).  In  addition,  normahzation  did  not  apply  to  ad  hoc,  special,  and  smah  committees,  nor  for  activities  other  than  re- 
search grants. 

10.  PERCENTILING:  This  is  the  mechanism  that  has  been  the  major  determinant  of  the  funding  decisions  of  ah  Institutes  since  the  Oc- 
tober 1988  Advisory  Council.  Each  study  section’s  approved  apphcations  are  ranked  in  percentiles  according  to  priority  scores  given 
in  the  current  and  previous  two  rounds.  The  percentiling  procedure  has  a normahzing  effect  on  study  section  scores,  but  without 
the  transposition  to  a normahzed  score.  As  with  priority  scores,  the  lower  the  numerical  value,  the  greater  the  merit  of  the  apph- 
cation. A basic  assumption  of  percentiling  is  that  the  quahty  of  reviewed  apphcations  is  roughly  eqmvalent  among  aU  study  sections 
but  that  there  are  differences  among  study  sections  in  rating  behavior. 

11.  CARRYOVERS:  These  are  grant  apphcations  which  are  approved  in  a given  year  but  not  funded  in  that  year;  they  are  kept  active 
from  one  fiscal  year  to  the  next. 

12.  THE  SUCCESS  RATE  FILE:  A DRG  computer  file  estabhshed  in  1978  to  provide  award  data  for  budget  reporting  and  computation 
of  success  rates.  This  file  substitutes  amendments  for  the  initial  apphcation  if  both  are  reviewed  in  the  same  fiscal  year.  Such  a 
substitution  eliminates  the  distortion  of  success  statistics  that  would  occur  if  both  the  original  apphcation  and  its  amendments  were 
counted  as  separate  apphcations  in  any  given  year. 
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13.  SUCCESS  RATE:  The  percentage  of  reviewed  applications  that  receive  funding.  Specifically,  it  is  the  number  of  competing  apphca- 
tions  to  be  funded  divided  by  the  number  of  appHcations  reviewed,  expressed  as  a percentage.  Carryovers  are  included  in  both  the 
numerator  and  denominator  in  the  fiscal  year  they  are  funded.  Applications  that  have  one  or  more  amendments  are  counted  only 
once  in  success-rate  computations.  Success  rates  are  influenced  by  a combination  of  factors,  including  study  section  action.  Council 
recommendation.  Institute  program  relevance,  and  funds  available.  They  are  included  for  selected  categories  throughout  this  report. 

14.  SUMMARY  STATEMENTS:  These  inform  the  Council  and  the  Institutes  of  the  evaluations  and  recommendations  of  initial  review 
groups  (IRG’s) ; they  also  provide  the  appHcant  with  information  about  the  review  of  his  or  her  apphcation.  They  include  a summary 
of  the  initial  review  group’s  comments  and  discussion  plus  the  assigned  priority  score,  percentile  rank,  dollar  support  requested  and 
recommended,  and  a roster  of  the  reviewers.  Numerous  NIH  poMcy  changes  have  progressively  made  more  information  available 
earher  to  apphcants.  Prior  to  1979,  review  conunents  were  provided  only  on  request.  Since  1984,  summary  statements  with  the  pri- 
ority score  and  percentile  rank  have  been  released  after  scientific  review  but  prior  to  Council  review.  Summary  statements  are  pre- 
pared by  Scientific  Review  Administrators  (SRA’s)  who  are  NIH  employees. 

16.  DRG  DEPARTMENT  CLASSIFICATIONS:  These  are  an  adaptation  of  the  codes  estabhshed  by  the  American  Association  of  Medical 
Colleges  (AAMC).  Basic  science  departments  include  anatomy,  biochemistry,  biology,  biophysics,  chemistry,  genetics,  microbiology, 
pathology,  pharmacology,  physics,  physiology,  zoology,  and  other  basic  sciences.  Chnical  science  departments  include  anesthesiology, 
dermatology,  family  practice,  medicine,  neurology,  obstetrics,  gynecology,  ophthalmology,  orthopedic  surgery,  otolaryngology,  pedia- 
trics, physical  medicine  and  rehabilitation,  psychiatry,  pubhc  health  and  preventive  medicine,  radiology,  surgery,  and  other  clinical 
sciences. 

17.  AGE:  This  is  computed  as  of  October  of  a given  fiscal  year. 

18.  DISAPPROVAL  VERSUS  NRFC:  Prior  to  1992,  appHcations  were  disapproved  because  a majority  of  study  section  members  felt  that 
a project  was  not  of  sufficient  scientific  merit  or  because  they  had  human  subject,  animal  welfare,  or  biohazard  concerns.  Currently, 
appHcations  which  do  not  have  significant  and  substantial  merit  or  that  raise  human  subject,  animal  welfare,  or  biohazard  concerns 
are  labeled  "Not  Recommended  for  Further  Consideration"  or  NRFC. 
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1.  WORKLOAD  OF  DRG  STUDY  SECTIONS 

NIH  Extramural  Grant  Support  Requested  by  Competing  Applications  Submitted  for  DRG  Study  Section  or 
Institute  Review,  FY  1992  2 

Number  of  Competing  Grant  Applications  Assigned  to  DRG  Study  Sections  Fiscal  Year  of  Initial  Review  1983-1992  4 
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Other  includes:  C06,  P01,  P41,  R03,  R13,  R15,  R18,  R22,  R29,  R37,  R43,  R44,  and  U01. 

Source;  NIH,  DRG,  ISB,  SAES 
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1.  Workload  of  DRG  Study  Sections 


In  FY  1992,  there  were  31,145  competing  grant  applications  submitted  to  NIH  and  processed  by  the  Division  of  Research  Grants  (DRG). 
(N.B.  These  statistics  do  not  include  data  for  NIAAA,  NIDA,  or  NIMH.  Subsequent  versions  of  this  book  will.)  Approximately  79  percent 
(24,708)  of  the  competing  apphcations  were  assigned  for  review  to  study  sections,  which  are  managed  by  DRG.  The  remaining  20.7  per- 
cent (6,437)  were  assigned  to  review  groups  in  the  various  Institutes.  Traditional  Research  Projects  (ROl)  reviewed  by  DRG  accounted 
for  about  54  percent  (16,837)  of  total  NIH  competing  apphcations.  Traditional  Research  Projects  (ROl)  assigned  to  DRG  for  review 
are  the  primary  focus  of  this  report,  and  unless  otherwise  stated,  are  the  only  data  provided  here.  At  the  outset,  however,  a context 
for  these  ROl’s  is  appropriate  so  as  to  make  manifest  the  variety  of  other  forms  of  NIH  support  and  review. 

Though  the  absolute  number  of  apphcations  assigned  to  DRG  study  sections  for  review  has  grown,  the  proportion  has  declined  by  seven 
percentage  points  since  1983.  This  is  due  primarily  to  shifts  in  numerous  smaher  programs  rather  than  to  a single  program  or  pohcy 
change.  Research  Career  Development  (K04)  apphcations,  for  example,  declined  significantly.  Among  Institute  reviews.  Clinical  Investiga- 
tor Awards  (K08),  Physician  Scientist  Awards  (Kll),  Smah  Grants  (R03),  Center  Grants  (P30,  P40,  P50,  P60),  Cooperative  Agreements 
(UOl),  and  certain  research  project  apphcations  submitted  in  response  to  Requests  for  Apphcations  grew  significantly. 

FY  1992  apphcations  assigned  to  DRG  study  sections  for  review  accounted  for  65.6  percent  of  the  money  requested,  or  3.2  of  the  4.2  bil- 
hon  doUars  in  requested  support  for  the  first  year  of  competing  apphcations. 


Applications*  Percentage  of 


( in 

oercentaaes ) 

Reouested 

Dollars 

fOOOs) 

1983 

1987  1992 

1983 

1987 

1992 

DRG  Review. . 

. .86.3 

79.6 

79.3 

73.1 

63.8 

65.6 

ROl 

. .65.1 

52.7 

54.1 

62.5 

50.0 

54.8 

T,K,F^^.  . . . 

. .10.6 

8.5 

8.2 

2.3 

1.4 

1.1 

Other 

. .10.6 

18.3 

17.1 

8.3 

12.5 

9.7 

Inst.  Review 

. . 13.7 

20.4 

20.7 

26.9 

36.2 

34.4 

ROl 

. . 2.0 

5.2 

4.0 

2.4 

6.6 

5.4 

T,K,F 

. . 3.2 

5.1 

4.9 

3.1 

3.5 

3.5 

P 

. . 2.5 

1.9 

2.7 

15.1 

14.4 

14.0 

Other** 

. . 6.0 

8.2 

9.1 

6.2 

11.7 

11.5 

Total 

.100.0 

100.0 

100.0 

100.0 

100.0 

100.0 

Number 

24,008 

28,934 

31,145 

Millions  2,271.2 

3,627.9 

4,840.0 

Workload  statistics  summarized  by  fiscal  year  of  IRG  review. 
See  subsequent  pages. 
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Number  of  Competing  Grant  Applications*  Assigned  to  DRG  Study  Sections 

Fiscal  Year  of  Initial  Review  1 983-1 992t 


Number 

(thousands) 

25 


23.9 


24.1 


24.7 


Training/Fellowships 
ther  Research 
SBIR  (R43,  R44) 
FIRST  (R23,  R29) 


Traditional  Research 
Projects  (R01) 


‘Workload  statistics  include  applications  deferred  or  withdrawn  prior  to  review. 
fSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 
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1.  Workload  of  DRG  Study  Sections 


Competing  applications  assigned  to  study  sections  for  review  increased  from  20,718  in  FY  1983  to  24,708  in  1992-up  3,990  applications. 
Traditional  research  project  applications  (ROl’s)  increased  from  15,618  to  16,837  between  1983  and  1992.  New  Investigator  Research 
(R23),  subsequently  called  FIRST  Awards  (R29);  Small  Business  Innovation  Research  (SBIR)  Grants  (R43,  R44);  Academic  Research  En- 
hancement Awards  (AREA,  or  R15);  and  Biomedical  Research  Support  Shared- Instrumentation  Grants  (SIO)  were  principal  gainers.  These 
were  partially  offset  by  declines  in  Research  Career  Development  Awards  (K04).  A fuUer  description  of  these  activities  can  be  found  in 
the  Appendices  (pp.  130f.). 


Number  of  Applications* 

t Summarized  by  FY  of  Initial  review^ 


Activity 

1983 

1985 

1987 

1989 

1991 

1992 

Traditional  Research  Projects  (ROl) 

15,618 

17,245 

15,245 

16,735 

15,605 

16,837 

Other  Research  Projects 

2,756 

4,542 

3,921 

4,029 

3,998 

POl 

21 

24 

17 

18 

12 

P41 

4 

2 

0 

0 

1 

R22 

92 

73 

91 

60 

43 

R23 

997 

1,162 

23 

6 

5 

1 

R29 

1 

2,634 

1,728 

1,723 

1,732 

R43,  R44 

1,475 

1,784 

2,079 

2,223 

2,191 

UOl 

108 

1 

2 

0 

0 

18 

Other  Research  Grants 

932 

1,225 

972 

1,210 

1,443 

1,426 

R15 

0 

426 

258 

713 

617 

568 

SIO 

262 

291 

221 

420 

480 

K04 

284 

359 

221 

152 

107 

119 

R13 

38 

54 

62 

63 

84 

74 

R03 

236 

29 

21 

22 

12 

56 

R43,R44 

66 

72 

80 

21 

20 

12 

K01,K08,K10,K11,R10,R18,R21, 

R23,R24,R25,R26,R29,U10 

34 

23 

39 

18 

183 

117 

Research  Centers 

P30,P40,P41,P50,U41 

28 

43 

23 

21 

32 

31 

Other  Activities 

C06,D43 

0 

0 

0 

0 

5 

0 

Training  Grants 

TOl , T02 , T03 , T15 , T22 , T32 , T3  5 

12 

31 

19 

24 

11 

11 

Fellowships 

2,259 

2,580 

2,223 

2,200 

2,158 

2,405 

F32 

1,938 

2,216 

1,895 

2,004 

1,833 

2,061 

F05,F06,F07,F20,F31,F33 

321 

364 

328 

196 

325 

344 

Totals . . . 

20,718 

23,880 

23,024 

24,111 

23,283 

24,708 

The  above  statistics  include  up  to  1,100  applications  per  year  that  are  subsequently  deferred  or  withdrawn.  These  are  excluded  from  this 
report’s  other  statistics,  which  deal  with  actions  of  study  sections  (Chapters  2-6) . Because  investigators  may  not  apply  for  MERIT  (Method 
to  Extend  Research  In  Time)  awards,  MERIT  (R37)  figures  have  been  included  with  the  Traditional  Research  (ROl)  totals. 
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Number  of  Competing  Grant  Applications*  Assigned  to  Non-DRG  Review  Groups 

Fiscal  Year  of  Initial  Review  1 983-1 992t 


Number 


1983  1985  1987  1989  1991  1992 


Training/Fellowships 

Research  Centers  & 

All  Other 

Other  Research  Grants 

Other  Research  Projects 

Traditional  Research 
Projects  (R01) 


*Workload  statistics  include  applications  deferred  or  withdrawn  prior  to  review. 
•fSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 
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1.  Workload  of  DRG  Study  Sections 


Competing  applications  assigned  to  Institute  review  groups  increased  from  3,290  in  ¥Y  1983  to  6,437  in  1992  — a 96  percent  increase. 
Traditional  research  project  applications  (ROl’s)  were  part  of  this  surge,  increasing  from  477  to  1,235  between  1983  and  1992.  (Virtually 
all,  or  at  least  a majority,  of  these  came  in  response  to  RFA’s.)  While  most  of  the  activities  have  shown  growth,  these  data  suggest  that 
the  Institutes  have  to  deal  with  a much  more  diverse  set  of  appHcations  than  does  the  Division  of  Research  Grants.  The  main  types  of 
research  proposals  referred  to  the  Institutes  were  either  large  in  scale  (POl’s)  or  small  in  scale  (R03’s).  POl  applications  grew  by  31  per- 
cent, while  R03  appHcations  increased  from  567  in  1983  to  854  in  1992.  Also  showing  substantial  growth  were  the  area  of  Cooperative 
Agreements  (the  U series,  particularly  UOl),  and  Research  Career  Programs  (the  K series,  especially  the  Clinical  Investigator  Award,  or 
K08).  These  data  also  show  that  most  fellowship  appHcations  are  reviewed  by  DRG,  while  most  training  grant  appHcations  are  reviewed 
by  the  Institutes.  A fuUer  description  of  these  activities  can  be  found  in  the  Appendix  (pp.  130f.). 


Number  of  Applications* 

t Summarized  by  FY  of  Initial  review^ 


Activity 

1983 

1985 

1987 

1989 

1991 

1992 

Traditional  Research  Projects  (ROl) 

477 

762 

1,511 

1,245 

1,669 

1 

,235 

Other  Research  Projects 

380 

851 

974 

845 

931 

1 

, 121 

POl 

368 

428 

445 

437 

476 

482 

UOl 

3 

313 

417 

371 

436 

541 

P42 , R23 , R29 , R35 , R43 , R44 , UOl 

9 

110 

112 

37 

19 

98 

Other  Research  Grants 

1,542 

1,912 

2,050 

1,619 

3,172 

2 

,655 

R03 

567 

453 

429 

378 

800 

854 

S03 

0 

0 

0 

0 

390 

386 

K08 

100 

446 

306 

295 

305 

360 

R13 

171 

217 

211 

218 

255 

269 

UlO 

299 

126 

266 

154 

256 

152 

Kll 

D42,K01,K04,K07,K10,K12,K14,K15,K16,R10,R15, 
R18 , R2 1 , R23 , R24 , R2  5 , R2  6 , R29 , R43 , R44 , S06 , S07 , 

0 

136 

169 

150 

158 

137 

S11,S14,S15,U09,U18,U24,U26,U50 

405 

534 

669 

424 

1,008 

497 

Research  Centers 

281 

366 

330 

360 

470 

421 

P50 

113 

133 

119 

137 

114 

123 

P20 

23 

1 

0 

32 

59 

105 

MOl 

57 

103 

84 

66 

65 

77 

P30 

51 

50 

49 

100 

128 

65 

G12 , P40 , P41 , P51 , P60 , U40 , U41 , U42 , U54 

37 

79 

78 

25 

104 

51 

All  Other  (C06,G07,G08,G20,P41,P50) 

66 

104 

150 

52 

187 

133 

Training  Grants 

470 

597 

550 

560 

603 

602 

Fellowships 

74 

133 

345 

329 

327 

270 

Total 

3,290 

4,727 

5,910 

5,010 

7,359 

6 

,437 

*For  economy  of  presentation,  selected  mechanism  statistics  have  been  presented  based  upon  the  most  frequent  activities  as  of  FY  1992. 
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Number  of  Competing  R01  Applications* 
Assigned  to  DRG  Study  Sections,  FY1983-1992t 


Number 

(thousands) 


M New  n Competing  Continuations 


% Continuation:  29.7 


28.7  37.5 


32.9 


35.2 


32.7 


*Summarized  by  fiscal  year  of  initial  review;  excludes  supplements;  workload  statistics  include 

applications  deferred  or  withdrawn  prior  to  review.  1 2/28/93 

t Selected  years.  W3cg3 

Source:  NIH,  DRG,  ISB,  SAES 
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1.  Workload  of  DRG  Study  Sections 


New  ROl  applications  assigned  to  DRG  study  sections  for  review  increased  from  10,876  (1983)  to  a peak  of  12,173  (1985).  They  then 
declined  to  9,360  in  1987  and  rose  again  to  11,189  in  1992. 


From  1983  to  1992,  competing  continuations  rose  proportionately  more  (approximately  18  percent),  from  4,601  in  1983  to  5,448  in  1993. 
They  followed  the  general  pattern  of  new  applications  after  the  3-year  lag  expected  for  competing  continuations.  In  the  1987  peak  year 
for  competing  continuations,  about  38  of  100  ROl  applications  were  competing  continuations;  by  1992,  however,  this  had  dropped  to 
approximately  33  of  every  100.  New  applications,  then,  have  shown  greater  volatility  over  this  period,  while  competing  continuations 
have  reached  a plateau  of  about  5,400. 


Change 

Change 


Percent 


Fiscal 

Year 

Total* 
ROl ' s 

New 

Competing 

Continuations 

Competing 

Continuations 

1983 

. . . 15,477 

10,876 

4,601 

29.7 

1984 

. . . 16,314 

11,543 

4,771 

29.2 

1985 

. . .17,083 

12 , 173 

4 ,910 

28.7 

1986 

, . . 16,071 

10,549 

5,522 

34.4 

1987 

. . .14,986 

9,360 

5,626 

37.5 

1988 

. . .14,989 

9,643 

5,346 

35.7 

1989 

. . . 16,554 

11,101 

5,453 

32.9 

1990 

. . . 16,699 

11,330 

5,369 

32 . 6 

1991 

. . .15,498 

10,046 

5,452 

35.2 

1992 

. . . 16,637 

11,189 

5,448 

32.7 

(1983-87) 

-491 

-1,516 

+1,025 

+7.8 

(1987-92) 

. . .+1,651 

+1,829 

-178 

-4.8 

Workload  statistics  summarized  by  fiscal  year  of  IRG  review. 
Excludes  competing  supplements. 


9 


Number  of  Original  and  Amended  R01  Applications* 
Assigned  to  DRG  Study  Sections,  FY1 983-1 992t 


Number 

(thousands) 


d Original  H Amended 


1983 

% Amended:  23.8 


1985  1987  1989 

25.0  28.8  31.1 


1991  1992 

36.4  33.5 


*Summarized  by  fiscal  year  of  initial  review;  excludes  supplements;  workload  statistics  include  applications 
deferred  or  withdrawn  prior  to  review.  1 2/29/93 

t Selected  years.  W4cg3 

Source:  NIH,  DRG,  ISB,  SAES 
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1.  Workload  of  DRG  Study  Sections 


A major  trend  in  ROl  applications  has  been  the  increase  in  amendments  to  previously  reviewed  applications.  NIH  policy  changes  since 
1979  authorizing  summary  statements  with  progressively  more  and  earlier  feedback  to  applicants,  probably  contributed  to  the  increase 
in  the  number  and  proportion  of  amended  ROl  applications.  Another  cause  was  that  the  number  of  favorably  recommended  but  unfunded 
apphcations  increased  significantly.  Since  1983,  amendments  increased  to  4,376  in  1986,  declined  slightly  in  1987  and  1988,  and 
increased  again  m 1990  to  a decade  high  of  5,743  (a  56  percent  increase  since  1983).  Amended  applications  have  declined,  but  only 
shghtly,  in  the  succeeding  years.  While  the  number  of  nonamended  applications  declined  about  6.2  percent  from  1983  through  1992, 
the  percentage  of  amended  apphcations  grew  from  23.8  percent  to  33.5  percent  over  the  same  period. 


Amendments 


Nonamendments 


Year 

Total* 

New 

Competing 

Continuation 

Total* 

New 

Competing 

Continuation 

1983. . . 

. .3,680 

2,315 

1,365 

11,797 

8,561 

3,236 

1984. . . 

. .3,856 

2,608 

1,248 

12,458 

8,935 

3,523 

1985. . . 

. .4,279 

2,930 

1,349 

12,804 

9,243 

3,561 

1986. . . 

. .4,376 

2,817 

1,559 

11,695 

7,732 

3,963 

1987. . . 

. .4,314 

2,545 

1,769 

10,672 

6,815 

3,857 

1988. . . 

. .4,043 

2,325 

1,718 

10,946 

7,318 

3,628 

1989.  . . 

. .5,143 

3,208 

1,935 

11,411 

7,893 

3,518 

1990. . . 

. .5,743 

3,543 

2,200 

10,956 

7,787 

3,169 

1991.  , . 

. .5,647 

3,373 

2,274 

9,851 

6,673 

3,178 

1992.  . . 

. .5,576 

3,356 

2,220 

11,061 

7,833 

3,228 

Change 

(1983-87) . 

. +634 

+230 

+404 

-1,125 

-1,746 

+621 

Change 

(1985-90) . 

.+1,464 

+811 

+451 

+389 

+1,018 

-629 

*Workload  statistics  are  summarized  by  fiscal  year  of  IRG  review,  include  withdrawals  and  deferrals,  and  exclude  competing  supplements. 
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Number  of  Competing  R01  Applications*  Reviewed  by  DRG  Study  Sections 

with  One  or  More  Amendments,  FY1 983-1 992t 


Number 


*Summarized  by  fiscal  year  of  initial  review;  includes  supplements.  Workload  statistics  include  applications 
deferred  or  withdrawn  prior  to  review, 
t Selected  years. 

Source:  NIH,  DRG,  ISB,  SAES 
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6/30/94 

W5cg3 


1.  Workload  of  DRG  Study  Sections 


The  proportion  of  second  or  third  amendments  to  ROl  appHcations  also  continues  to  increase.  However,  these  multiple  amendments  (and 
therefore  total  amendments)  are  probably  understated  in  the  IMPAC  data  system  by  an  unknown  amount.  DRG  procedures  have  permitted 
and  sometimes  encouraged  the  submission  of  amended  appUcations  beyond  the  third  revision  as  new  appHcations  with  new  numbers. 


Number 

of 

Amendments 

1983 

1985 

1 

83.5 

79.4 

2 

14.6 

16.8 

More  than  2. .. . 

1.9 

3.8 

Total 

100.0 

100.0 

Number 

3 , 683 

4,282 

1987 

1989 

1991 

1992 

76.7 

77.5 

70.0 

69.6 

19.1 

18.1 

22.7 

22 . 3 

4.2 

4.4 

7.3 

8.1 

100.0 

100.0 

100.0 

100.0 

4,316 

5,147 

5,655 

5,584 

The  number  of  appHcations  either  withdrawn  or  deferred  from  DRG  review  declined  approximately  25  percent  over  the  period  FY  1983- 
1992.  By  contrast,  the  number  of  appHcations  either  withdrawn  or  deferred  from  Institute  review  decHned  3.9  percent.  At  DRG,  with- 
drawn appHcations  actuaUy  increased  sHghtly  (0.6  percent),  while  deferred  appHcations  decHned  by  more  than  51  percent.  Withdrawn 
Institute-reviewed  appHcations  increased  markedly  (36.1  percent)  while  their  deferred  appHcations  dropped  (43.6  percent). 


DRG* Non-DRG* 


1983 

1987 

1991 

1992 

1983 

1987 

1991 

1992 

Withdrawn. 

. .462 

708 

470 

465 

219 

391 

254 

298 

ROl 

. .305 

474 

332 

325 

52 

103 

51 

103 

Other. . . 

. . 157 

234 

138 

140 

167 

288 

203 

195 

Deferred. . 

. .427 

349 

197 

207 

220 

214 

193 

124 

ROl 

. .341 

263 

157 

166 

129 

115 

86 

58 

Other. . . 

. . 86 

86 

40 

41 

91 

99 

107 

66 

Total 

. .889 

1,057 

667 

672 

439 

605 

447 

422 

*Workload  statistics  summarized  by  fiscal  year  of  IRG  review. 
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Amendments  as  a Percentage  of  Competing  R01  Applications* 
Assigned  to  DRG  Study  Sections,  FY1 983-1 992t 


M Amendments  M Originals 


New  Applications 


Percent 


Competing  Continuations 

z 


1983 

1985 

1987 

1989 

1991 

1992 

1983 

1985 

1987 

1989 

1991 

1992 

10,876 

12,173 

9,360 

11,101 

10,046 

11,189 

4,601 

4,910 

5,626 

5,453 

5,452 

5,448 

‘Original  and  amended  applications  summarized  by  fiscal  year  of  initial  review.  Workload  statistics  include  withdrawals  and  deferrals. 
tSelected  years. 

Source;  NIH,  DRG,  ISB,  SAES 


12/29/93 

W6cg3 
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1.  Workload  of  DRG  Study  Sections 


Amendments  to  new  applications  increased  from  21.3  percent  in  1983  to  30.0  in  1992  (+8.7  percentage  points).  Competing  continuations 
showed  an  even  higher  proportion  of  amendments  as  appHcants  sought  to  ensure  continuation  of  their  NIH  funding.  Amendments  to 
competing  continuations  increased  steadily  from  29.7  percent  in  1983  to  a high  of  41.7  percent  in  1991  (+12.0  points).  Clearly,  amend- 
ments have  played  a major  role  in  the  increase  in  both  new  and  competing  continuation  applications  since  1983. 


Total* 


New 

Applications 


Competing 

Continuations 


Year 

Number 

%A 

Number 

o\o 

> 

Number 

o\o 

> 

1983.  . . 

. . .15,477 

23.8 

10,876 

21.3 

4,601 

29.7 

1984. . . 

. . . 16,314 

23.6 

11,543 

22.6 

4,771 

26.2 

1985. . . 

. . . 17,083 

25.0 

12,173 

24.1 

4,910 

27.5 

1986. . . 

. . . 16,071 

27.2 

10,549 

26.7 

5,522 

28.2 

1987. . . 

. . .14,986 

28.8 

9,360 

27.2 

5,626 

31.4 

1988. . . 

. . . 14 , 989 

27.0 

9,643 

24 . 1 

5,346 

32.1 

1989.  . . 

. . . 16,554 

31.1 

11,101 

28.9 

5,453 

35.5 

1990. . . 

. . . 16,700 

34.4 

11,330 

31.3 

5,369 

41.0 

1991. . . 

. . . 15,498 

36.4 

10,046 

33 . 6 

5,452 

41.7 

1992  . . . 

. . . 16,637 

33 . 5 

11,189 

30.0 

5,448 

40.7 

Change 

(1983-87) . . , 

. . . . -491 

+5.0  pts.  -1,516 

+5.9 

+1,025 

+1.7 

Change 

(1987-92) . . , 

+1,651 

+4.7  pts.  +1,829 

+2.8 

-178 

+9.3 

*Workload  statistics  are  summarized  by  fiscal  year  of  IRG  review,  include  withdrawals  and  deferrals,  and  exclude  competing  supplements. 
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Percentage  of  Competing  R01  Applications*  Reviewed  by  DRG  Study  Sections 

by  Funding  Status,  FY1 965-1 992t 


Funded 


M Rated,  Unfunded 


E3  Disapproved/NRFC 


Percent 


‘Summarized  by  requested  start  date  or  fiscal  year  of  funds;  excludes  withdrawals  and  supplements. 
Includes  funded  carryover  (except  ’65-'69).  Data  for  70-‘92  from  success  rate  file. 
tSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 
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I.  Workload  of  DRG  Study  Sections 


Through  1991,  the  combination  of  three  trends-increasing  ROl  applications,  diminishing  disapprovals,  and  increasingly  limited  funds-- 
resulted  in  large  numbers  of  approved  but  unfunded  applications.  An  important  reclassification  created  the  category  "Not  Recommended 
for  Further  Consideration"  (NRFC)  in  1992.  Previously,  applications  were  disapproved  because  a majority  of  study  section  members  felt 
that  a project  was  not  of  sufficient  scientific  merit  or  because  of  human  subject,  animal  welfare,  or  biohazard  concerns.  Now,  applications 
that  do  not  have  significant  and  substantial  merit  or  that  have  human  subject,  animal  welfare,  or  biohazard  concerns  are  labeled  NRFC. 

Effectively,  this  decreased  the  percentage  of  applications  which  were  approved  but  not  funded.  While  there  was  a slight  decrease  in  the 
number  of  DRG-reviewed  competing  ROl  applications  (14,272  in  1983  to  14,072  in  1992),  the  number  that  received  NIH  funding  has 
declined  markedly  (4,543  decreasing  to  3,845,  a 15.3  percent  drop).  At  the  same  time,  the  number  disapproved  (or  not  recommended 
for  further  consideration)  by  DRG  study  sections  increased  from  1,738  to  3,041.  Eligible  but  unfunded  applications  decreased  approx- 
imately 10  percent,  from  8,033  in  1983  to  7,212  in  1992.  Before  1976,  the  number  funded  often  equaled  or  exceeded  the  number  ap- 
proved but  unfunded.  Thereafter,  more  approved  applications  have  remained  unfunded  than  have  been  funded.  By  1992,  there  were 
3,845  applications  funded,  but  7,212  eligible  applications  were  not  funded  (a  ratio  of  1.9  to  1). 

An  increase  in  amended  applications,  which,  in  turn,  heightened  an  already  intense  competition,  is  another  probable  result  of  decreased 
chances  of  funding.  By  1992,  over  41  percent  of  the  3,845  funded  applications  were  amendments,  well  over  the  approximately  25  percent 
for  1983.  The  number  of  funded  initial  applications,  then,  was  severely  cut  (34  percent),  from  3,422  to  2,246.  The  proportion  of  amend- 
ed applications  that  were  ehgible  but  remained  unfunded  has  also  increased  since  1983. 


Fiscal  Funded Rated , Unfunded 


Year* 

Total 

Amdmnts 

% 

Total 

Amdmnts 

% 

1983. . . 

. .4,543 

1,121 

24.7 

8,033 

2,027 

25.2 

1984. . . 

. .4,540 

1,035 

22.8 

8,287 

2,015 

24.3 

1985. . . 

. .5,024 

1,246 

24.8 

9,141 

2,342 

25.6 

1986. . , 

. .4,695 

1,188 

25.3 

9,156 

2,310 

25.2 

1987. . . 

. .4,631 

1,375 

29.7 

7,596 

2,264 

29.8 

1988. . . 

. .4,259 

1,176 

27.6 

8,246 

2,234 

27.1 

1989.  . . 

. .3,636 

1,104 

30.4 

9,897 

3,091 

31.2 

1990. . . 

. .3,266 

1,247 

38.2 

11,244 

3,662 

32.6 

1991. . . 

. .3,758 

1,606 

42.7 

9,846 

3,280 

33.3 

1992.  . . 

. .3,845 

1,599 

41.2 

7,212 

2,554 

35.4 

Change 

(1983-87) . . 

-t-88 

+254 

-437 

+237 

Change 

(1987-92) . . 

. . -786 

+224 

-384 

+290 

*Summarized  from  award  rate  file  by  fiscal  year  of  funding  or  requested  start  date. 
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Number  of  DRG-Reviewed  Competing  R01  Applications,*  FY1 965-1 992t 

by  Funding  Status  and  Type 


Number 

(thousands) 


H Funded  M Rated,  Unfunded 

New  Applications 


□ Disapproved/NRFC 
Competing  Continuations 


1965  1975  1980  1985  1990  1992 


1965  1975  1980  1985  1990  1992 


‘Summarized  by  requested  start  date  or  fiscal  year  of  funds.  Excludes  withdrawals  and  supplements. 
Includes  funded  carryover  (except  1965). 
tSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 


6/1 4/94 
W8cg3 


1.  Workload  of  DRG  Study  Sections 


The  growth  in  number  of  rated  but  unfunded  applications  is  especially  striking  among  new  submissions.  In  1983,  there  were  5,929  (59 
percent)  new  ROl  apphcations  of  a total  10,005  which  were  unfunded;  by  1991,  this  had  increased  to  7,113  of  9,248  appHcations  (77 
percent).  The  increased  approval  rate  contributed  to  the  large  numbers  of  unfunded  apphcations.  Effective  in  1992,  the  NIH  no  longer 
use  the  concepts  of  recommended  "approval"  or  "disapproval;"  as  a result,  the  concept  of  "approved,  but  not  funded"  will  no  longer  be 
appropriate.  Instead,  as  discussed  previously,  the  number  of  new  apphcations  classified  as  NRFC  (Not  Recommended  for  Further 
Consideration)  swehed  to  a value  almost  ten  times  the  1991  "disapproved"  count. 


Approved  but  unfunded  competing  continuation  apphcations  also  increased  substantiaUy,  though  not  as  dramaticaUy  because  of  their 
smaher  number.  The  competing  continuation  apphcations  which  remained  unfunded  in  1983  were  2,104  of  4,309  (49  percent).  They 
increased  to  3,014  of  4,656  (65  percent)  by  1990.  Increased  approval  rates  had  less  impact  upon  competing  continuation  apphcations 
because  of  their  historicaUy  high  approval  rates.  With  the  advent  of  NRFC  (1992),  the  number  of  ehgible  but  unfunded  competing 
continuation  apphcations  declined  sharply  (21  percent),  but  not  as  sharply  as  the  corresponding  component  of  new  apphcations  (29 
percent). 


Change 

Change 


New  Applications Competing  Continuations 


Year 

Funded 

Rated, 

Unfunded 

Disapproved/ 

NRFC 

Funded 

Rated, 

Unfunded 

Disapproved/ 

NRFC 

1983 

.2,468 

5,929 

1,608 

2 , 075 

2,104 

130 

1984 

.2,441 

6,270 

1,470 

2 , 099 

2,017 

102 

1985 

.2,654 

7,132 

1,259 

2,370 

2,009 

81 

1986 

.2,395 

6,939 

883 

2,300 

2,217 

44 

1987 

.2,055 

5,406 

620 

2,576 

2,190 

46 

1988 

.1,906 

6,006 

508 

2,353 

2,240 

35 

1989 

.1,797 

7,300 

389 

1,839 

2,597 

15 

1990 

.1,643 

8,230 

282 

1,623 

3 , 014 

19 

1991 

.1,867 

7,113 

268 

1,891 

2,733 

21 

1992 

.1,924 

5,058 

2,500 

1,921 

2,154 

541 

(1983-87) 

-413 

-523 

-988 

+501 

+86 

-84 

(1987-92) 

-131 

-348 

+1,880 

-655 

-36 

+495 

By  requested  start  date  or  fiscal  year  of  funds. 


Data  are  from  the  award  rate  file,  in  which  amendments  replace  their  initial  apphcation  if  reviewed  in  the  same  fiscal  year. 
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2.  STUDY  SECTION  ACHON  ON  COMPETING  ROl  APPUCATIONS 


NIH  review  policy  changes:  Mean  priority  score  trends 

Not  Recommended  for  Further  Consideration  (NRFC)  Effects 

Priority  score  distribution  trends 

Shift  in  frequency  distribution  of  priority  scores 

Selected  grant  activities:  Mean  priority  score  trends 

Requested  and  IRG-recommended  dollar  support 


Mean  Priority  Scores  of  DRG-Rated  R01  Applications  in 
Relation  to  NIH  Review  Policy  Changes,  FY1965  - 1992* ** 


New  Competing  ■■■'■  ' ' Total 

Mean  Score  Continuations 


* Raw  scores  summarized  by  fiscal  year  of  funding  or  requested  start  date;  1 970-1 992  from  success  rate  file. 

**  Normalization  of  scores  limited  to  some  institutes  (AG,  Al,  CA,  EY,  HD,  HL  in  1978). 

Source:  NIH,  DRG,  ISB,  SAES 


6/30/94 

W9cg3 


2.  Study  Section  Recommendations  on  Competing  ROl  ^plications 


IN^ean  -priority-score  trends  for  ROl  applications  reviewed  by  DRG  study  sections  generally  fall  into  five  periods:  (1)  a decline  (or  shift 
toward  100)  from  1965  to  1970,  (2)  a steady  increase  (a  shift  toward  500)  from  1970  to  1980,  (3)  a rather  sharp  decline  from  1980  to 
1987,  (4)  a sharp  upward  rebound  from  1988  to  1989,  and  (5)  a continued  decline  from  1989  through  1992.  This  chart  covers  a 28-year 
period.  Data  from  1970-1992  (but  not  from  previous  years)  are  available  from  an  award  rate  file  that  cotmts  each  application  and  its 
amendments  from  the  same  fiscal  year  as  one  unit. 

Changes  in  reviewing  procedures  can  affect  mean  priority  scores.  For  example,  to  improve  comparability  among  study  sections,  DRG  com- 
puted standardized  scores  from  November  1971  to  June  1980,  and  some  Institutes  used  them  in  their  funding  decisions.  (Standardized 
scores  were  based  on  a mathematical  transformation  of  raw  priority  scores  for  each  study  section  to  a distribution  with  a mean  of  250 
and  a standard  deviation  of  70.)  The  upward  trend  in  mean  priority  scores  from  1971  to  1980  is  contemporaneous  with  standardization. 

The  meanings  and  effects  of  being  rated  (approved)  and  disapproved,  in  short,  have  changed.  When  funds  were  plentiful,  recommending 
approval  approximated  granting  funding  more  closely.  As  seen  in  Chapter  1,  when  funding  was  in  short  supply,  many  approved  applica- 
tions were  not  funded.  With  priority  scores  changing  to  incorporate  disapprovals  as  scores  of  501,  the  period  from  1970-1980  shows  an 
improvement  in  the  mean  scores  of  new  ROl  apphcations  reviewed  by  DRG.  Competing  continuations,  with  their  higher  approval  rates, 
showed  less  of  an  effect  on  scores  during  standardization.  Furthermore,  the  trend  toward  lower  mean  priority  scores  before  standardiza- 
tion and  since  June  1980,  suggests  that  standardization  might,  in  fact,  have  slowed  a long-term  trend  toward  lower  mean  priority  scores. 


New  Applications Competing  Continuations 


Approved 

Reviewed 

Appr . 

Approved 

Reviewed 

Appr 

Year 

Mean 

Mean* 

Rate 

Mean 

Mean* 

Rate 

1965. . , 

262 

373 

53 

257 

305 

80 

1970. . . 

244 

353 

57 

228 

277 

82 

1975. . . 

259 

336 

68 

222 

252 

89 

1980. . . 

276 

334 

74 

225 

243 

93 

1985.  . . 

244 

273 

89 

193 

198 

98 

1988. . . 

236 

252 

94 

183 

186 

99 

1989. . . 

264 

274 

96 

212 

213 

99 

1990. . . 

258 

264 

97 

205 

207 

99 

1991. . . 

250 

257 

97 

200 

201 

99 

1992. . . 

228 

275 

74 

191 

212 

88 

*Reviewed  mean  scores  include  disapprovals  as  501.  Summarized  by  fiscal  year  of  funds  or  requested  start  date. 
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Percent  Distribution  of  DRG-Reviewed  R01  Applications 
by  Priority  Score  intervai,  Councii  Year  1991  Versus  Councii  Year  1992 


Percent 


M Council  Year  1991  M Council  Year  1992 


100-  126-  151-  176-  201-  226-  251-  276-  301-  326-  351-  376-  401-  426-  451-  476-  DisV 
125  150  175  200  225  250  275  300  325  350  375  400  425  450  475  500  NRFC 


Source:  NIH,  DRG,  ISB,  SAES 


12/29/93 

W28cg3 


2.  Study  Section  Recommendations  on  Competing  ROl  ^plications 


The  chart  on  page  24  reflects  the  effects  on  the  priority  score  distributions  of  the  NRFC  conversion.  There  are  two  notable  features  about 
these  data,  one  obvious  and  the  other  subtle.  Clearly,  the  conversion  did  increase  the  number  and  percentage  of  cases  deemed  inappropri- 
ate for  funding  (roughly,  by  a factor  of  5,  from  2 percent  to  10  percent).  Note,  however,  that  2,723  ROl  applications  reviewed  in  1992 
got  priority  scores  higher  than  300.  As  the  chart  and  table  display,  this  does  not  differ  very  much  from  the  corresponding  part  of  the 
distribution  before  the  NRFC  change.  It  should  be  noted,  though,  that  the  some  of  the  descriptive  adjectives  and  score  range  pairing  were 
also  changed  concurrent  with  the  NRFC  conversion.  These  2,723  ROl  apphcations  were  at  least  found  to  be  "acceptable",  if  not  "good". 


Secondly,  while  there  seems  to  be  some  decline  between  1991  and  1992  in  the  percentage  of  apphcations  in  the  "fundable"  priority  score 
region  of  100-175,  the  remainder  of  the  two  distributions  appear  to  be  remarkably  similar. 


Priority 

1991 

1992 

Score 

Cumulative 

Cumulative 

Interval 

Number 

Percent 

Percent 

Number 

Percent 

Percent 

100-125 

516 

3.5% 

3.5% 

367 

2.3% 

2.3% 

126-150 

2,144 

14.6% 

18.1% 

1,983 

12.4% 

14.7% 

151-175 

2,054 

14.0% 

32.0% 

2,041 

12.8% 

27.5% 

176-200 

1,698 

11.5% 

43.6% 

1,839 

11.5% 

39.0% 

201-225 

1,554 

10.6% 

54.1% 

1,605 

10.0% 

49.0% 

226-250 

1,495 

10.2% 

64.3% 

1,530 

9.6% 

58.6% 

251-275 

1,212 

8.2% 

72.5% 

1,273 

8.0% 

66.5% 

276-300 

939 

6.4% 

78.9% 

931 

5.8% 

72.4% 

301-325 

676 

4.6% 

83.5% 

733 

4.6% 

77.0% 

326-350 

605 

4.1% 

87.6% 

594 

3.7% 

80.7% 

351-375 

425 

2.9% 

90.5% 

464 

2.9% 

83.6% 

376-400 

354 

2.4% 

92.9% 

384 

2.4% 

86.0% 

401-425 

215 

1.5% 

94.4% 

263 

1.6% 

87.6% 

426-450 

217 

1.5% 

95.8% 

182 

1.1% 

88.8% 

451-475 

151 

1.0% 

96.9% 

75 

0.5% 

89.2% 

476-500 

130 

0.9% 

97.8% 

28 

0.2% 

89.4% 

Disapp/NRFC 

331 

2.2% 

100.0% 

1,695 

10.6% 

100.0% 

Total 

14,716 

100.0% 

15,987 

100.0% 

25 


Distribution  of  R01  Applications*  Rated  by  DRG  Study  Sections 
by  Priority  Score  Interval**,  FY1 983-1 992t 

® 100-  175  H 176-200  H 201  -275  □ 276-500  M Dis./NRFC 


1992 


1991 


1989 


1987 


1985 


1983 

0 


Mean  Score 
259 

236 

252 

230 
248 
266 

25  50  75  100  % 


* Original  and  amended  applications  summarized  by  fiscal  year  of  initial  review;  excludes  withdrawals  and  supplements. 
**Uneven  score  intervals, 
t Selected  years. 

Source;  NIH,  DRG,  ISB,  SAES 


1/31/94 

W10cg3 


2.  Study  Section  Recommendations  on  Conq>eting  ROl  implications 


A major  trend  in  the  review  of  ROl  applications  has  been  the  increase  in  favorable  priority  scores.  The  proportion  of  ROl  applications 
with  scores  of  100  to  175  showed  a steady  annual  increase  from  1983  through  1988.  To  curtail  this  trend,  NIH  instituted  percentiling 
and  a standard  set  of  adjectives  to  be  used  by  IRG’s.  As  a result,  mean  priority  scores  rose  sharply  in  1989,  but  began  to  shift  toward 
100  again  in  1990.  Applications  receiving  scores  between  100  and  175  increased  by  11.2  percentage  points  as  shown  in  the  table  below, 
from  27.8  percent  of  approvals  in  1983  to  39.0  percent  in  1987.  By  1989,  however,  only  25.5  percent  of  scores  were  in  the  best  priority- 
score  range.  And,  by  1992,  this  number  had  increased  to  27.3  percent. 

These  shifts  were  not  confined  to  particular  priority-score  intervals.  Rather,  there  was  a general  improvement  across  the  total  range  of 
scores,  with  a declining  proportion  of  applications  in  the  poorest  score  intervals  as  well  as  in  the  intermediate  range.  Applications  in  the 
poorer  half  of  the  rating  scale  (scores  301  to  500)  declined  by  2.1  points,  from  19.1  percent  in  1983  to  17.0  percent  by  1992. 


Scores 

1983 

1985 

1987 

1989 

1991 

1992 

1983-92 

100-125. . . 

. . 2.1 

2.6 

3.6 

1.6 

3 . 3 

2 . 1 

0.0 

126-150. . . 

..10.6 

16.0 

20.7 

10.1 

14 . 6 

12.3 

-HI. 8 

151-175. . . 

..15.1 

14.4 

14.7 

13.8 

14 . 0 

12.8 

-2.3 

176-200. . . 

. . 9.4 

9.9 

11.1 

10.7 

11.6 

11.5 

+2.1 

201-225. . . 

. . 8.3 

8.9 

9.3 

10.2 

10.6 

10.1 

+1.8 

226-250. . . 

. . 8.7 

9.6 

9.0 

10.6 

10.2 

9.6 

+0.9 

251-275. . . 

. . 9.0 

7.9 

6.9 

9.1 

8.2 

8.0 

-1.0 

276-300. . . 

. . 6.2 

5.8 

5.4 

7 . 8 

6.4 

5.9 

-0.3 

301-400. . . 

. .14.8 

12.9 

10.8 

17.7 

14.0 

13.6 

-1.2 

401-500. . . 

. . 4.3 

4.2 

3.8 

6.1 

4.9 

3.4 

-0.9 

Dis. /NRFC. 

. .11.5 

7.7 

4.7 

2.4 

2.3 

10.6 

-0.9 

Total 

.100.0 

100.0 

100.0 

100.0 

100.0 

100.0 

Number. . . . 

14,931 

16,418 

13,278 

15,871 

14,850 

15,990 

(Due  to  rounding,  some  totals  may  only  approximate  100.0.) 


To  permit  more  precise  evaluation  of  appHcations,  NIH  allowed  ratings  in  0.5  intervals  beginning  September  1970  and  in  0.1  intervals 
beginning  June  1980.  Although  this  change  can  uncover  small  differences  in  the  relative  position  of  individual  applications,  it  cannot 
change  overall  score  trends  directly. 


27 


Priority-Score  Distributions  of  Competing  R01  Appiications 
Rated  by  DRG  Study  Sections,  FY1983,  1988,  1992* 


Percent 


'Summarized  by  fiscal  year  of  initial  review;  excludes  withdrawals  and  supplements. 
Source:  NIH,  DRG,  ISB,  SAES 


12/30/93 

W13cg3 


2.  Study  Section  Recommendations  on  Competing  ROl  T^plications 


All  three  of  these  distributions  exhibit  approximately  the  same  positive  skew.  The  principal  change  between  1983  and  1988  in  ROl  score 
distributions  was  an  increase  in  the  range  126  to  150  — up  6.3  percentage  points  from  11.9  to  18.2  percent.  This  would  be  consistent 
with  the  lowest  (best)  priority  score  period  in  history  (cf.  pages  22f.). 

The  shift  toward  priority  scores  of  175  or  better  from  1983  to  1988  is  clear  in  these  distributions.  The  largest  change  was  in  scores  of 
126  to  175.  Cumulatively,  the  percentage  of  scores  under  175  grew  from  29.0  percent  to  35.0  percent.  But  by  1992,  this  trend  had  re- 
versed; scores  from  126  to  175  declined  by  4.3  percentage  points  and  made  up  28.1  percent  of  rated  applications. 


Percentage 


Score 

Distribution 

Point 

Chanae 

Scores 

1983 

1988 

1992 

1983-88 

1988-92 

100-125 

2.4% 

2 . 6% 

2.4% 

+0.2 

-0.2 

126-150 

..  11.9 

18.2 

13.8 

+6.3 

-4.4 

151-175 

..  17.0 

14.2 

14.3 

-2.8 

+0.1 

176-300 

..  47.0 

45.1 

50.5 

-2.0 

+5.4 

>300 

..  21.7 

19.9 

19.0 

-1.7 

-0.9 

Total 

. . 100.0 

100.0 

100.0 

Number* .... 

. .13,208 

13,367 

14,293 

Mean 

229 

230 

Std.  Dev.  . 

..  82.8 

86.1 

79.7 

Coeff.  Var. 

..  35.1% 

37.6% 

34.7% 

*Rated  applications  by  fiscal  year  of  IRG  review. 


The  standard  deviation  of  scores  declined  from  82.8  in  1983  to  79.7  in  1992,  showing  a decline  in  variability  of  priority  scores.  As  scores 
edge  toward  their  limit  of  100,  the  coefficient  of  variation  may  provide  a more  meaningful  measure  of  relative  change  in  the  variability 
or  dispersion  of  scores.  It  has  remained  relatively  constant,  despite  the  changes  in  the  means  and  standard  deviations. 
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Mean  Priority  Scores  of  Competing  Appiications 
for  Selected  Grant  Activities,  FY1 983-1 992* 


Mean  Score 


DRG  Review  Institute  Review 


1983  1984  1985  1986  1987  1988 


1989  1990  1991  1992 


‘Summarized  by  fiscal  year  of  initial  review;  excludes  withdrawals  and  deferrals. 
Source:  NIH,  DRG,  ISB,  SAES 


12/30/93 

W14cg3 


2.  Study  Section  RecommendatioRS  on  Competing  ROl  ^plications 


The  decline  in  mean  priority  scores  from  1983  to  1988  is  not  unique  to  ROl  applications  reviewed  by  DRG  study  sections,  A comparable 
trend  is  found  in  New  Investigator  Research  Awards  (R23,  or  later,  R29)  and  Fellowships,  as  well  as  in  applications  reviewed  by  Institute 
review  groups  such  as  Research  Centers  and  Research  Program  Projects  (POl’s).  These  separate  trends  also  generally  echo  the  1988  to 
1989  rise  in  scores,  followed  by  the  decline  from  1990  through  1992.  Score  decHnes  from  1983  to  1988  ranged  from  as  few  as  7 points 
for  ROl’s  reviewed  by  Institutes  to  32  points  for  Fellowships.  Institute-reviewed  ROl’s  began  receiving  the  highest  average  scores  (i.e., 
closer  to  500)  in  1987,  and  this  pattern  has  continued  through  1992,  although  their  means  did  decline  sHghtly.  Fellowships  (DRG- 
reviewed)  and  Centers  (Institute-reviewed)  did  depart  from  the  1989  through  1992  decrease  shown  by  other  mechanisms. 


DRG 

Review 

Institute 

Review 

Year 

ROl 

R23 ,R29 

Fellowshics 

ROl 

POl 

Centers 

1983. . . 

, . .236 

229 

203 

246 

200 

211 

1984.  . . 

, . .233 

232 

203 

238 

198 

199 

1985. . . 

, . .227 

222 

194 

236 

195 

198 

1986. . . 

, . .218 

218 

195 

216 

179 

203 

1987.  . . 

, . .217 

220 

183 

232 

180 

186 

1988. . , 

. . .215 

216 

181 

239 

190 

201 

1989. . . 

. . .245 

234 

200 

255 

199 

208 

1990. . . 

. . .236 

229 

207 

247 

194 

202 

1991. . . 

. . .230 

225 

205 

244 

185 

217 

1992.  . . 

. . .230 

209 

208 

243 

178 

216 

(1983-92) . . . 

, . . -6 

-20 

5 

-3 

-22 

5 

Summarized  by  fiscal  year  of  IRG  review. 
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Requested  and  IRG-Recommended  Dollar  Support  on  Competing  R01 
Applications*  Reviewed  by  DRG  Study  Sections,  FY1 983-1 992t 


Millions 

$3,000 


2,500 


2,000 


1,500 


1,000 


500 


M Recommended  Dollars 


H Requested  but  not 

Recommended  Dollars** 


Percent 

Recommended 

Dollars: 


Disapproved/NRFC 

Applications 


*First  year  of  requested  support  summarized  by  fiscal  year  of  initial  review.  Excludes  withdrawals  and  supplements. 
‘‘Dollar  reduction  in  recommended  applications. 

■fSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 


6/30/94 

W15cg3 


2.  Study  Section  Recommendations  on  Competing  ROl  Applications 


The  amount  of  first-year  support  requested  in  ROl  applications  reviewed  by  DRG  study  sections  nearly  doubled  in  ten  years,  from  approxi- 
mately $1.4  billion  in  1983  to  over  $2.5  billion  in  1992. 

Rating  (previously  known  as  approval)  of  ROl  applications  increased  from  88.5  percent  in  1983  to  a high  of  98.1  in  1990.  With  the  im- 
plementation of  the  NRFC  classification  in  1992,  the  percent  rated  fell  to  89.4.  Total  recommended  first-year  direct-cost  dollar  support, 
however,  was  considerably  lower  — 72.3  percent  in  1983  increasing  to  85.1  percent  in  1991  and  then  dropping  sharply  in  1992,  Initial 
review  groups  are  recommending  fewer  cuts  in  apphcants’  requested  support  amounts:  cuts  in  rated  projects’  budgets  are  down  by  5.6 
percentage  points  from  1983  through  1992. 


Amount  Requested  No.  of  Applications 


1983 

1988 

1992 

1983 

1988 

1992 

Rated 

. . . 72.3 

83.5 

78.8 

88.5 

91.4 

89.4 

Total  Disapproved 

. . . 27.7 

16.5 

21.2 

11.5 

8.6 

10.6 

Disapprovals  (NRFC) 

. . . 11.5 

3.9 

10.6 

11.5 

8.6 

10.6 

$ Reduction 

...  16.2 

12 . 6 

10.6 

— 

— 

— 

Total 

. . .100.0 

100.0 

100.0 

100.0 

100.0 

100.0 

Amount*  

.$1,365.4 

1,789.6 

2 , 527 . 3 

$14,928 

13,942 

16,013 

Recommended  dollar  reduction  was  somewhat  greater  on  competing  continuations  than  on  new  applications  imtQ  1992;  generally  speak- 
ing, however,  this  reduction  was  more  than  offset  by  an  extremely  high  proportion  of  competing  continuation  appHcations  which  were 
rated.  Additionally,  the  impact  of  the  NRFC  classification  was  greater  upon  new  appHcations  than  competing  continuations. 


Percentages 

New  Applications  Competing  Continuations 


1983 

1988 

1992 

1983 

1988 

1992 

Rated 

. 68.8 

81.8 

75.7 

79.2 

86.1 

84.3 

Total  Disapproved 

. 31.2 

18.2 

24.3 

20.8 

13.9 

15.7 

Disapprovals  (NRFC) . . 

. 15.1 

5.9 

17.9 

3.0 

0.7 

4.3 

$ Reduction 

. 16.1 

12.3 

6.4 

17.8 

13.2 

11.4 

Total 

.100.0 

100.0 

100.0 

100.0 

100.0 

100.0 

Amount*  

.$912.5 

1,102.4 

1,631.2 

$452.9 

687.2 

896.1 

*First-year  request  in  milHons  of  dollars.  Summarized  by  fiscal  year  of  IRC  review. 
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3. 


APPUCATION  CHARACTERISTICS  (ROl)  RELATED  TO  STUDY  SECTION  ACTION 


Application  Type:  New,  competing  continuation 

Study  section  actions:  Disapproval/NRFC,  score  distributions 
Trends  in  mean  priority  scores:  Amended,  non-amended,  success  rates 
Requested  years  of  support 

Distribution  of  applications  by  requested  years 
Requested  versus  approved  years  of  support 
Trends  in  mean  priority  scores  by  requested  years 
Study  section  actions:  Disapproval/NRFC,  score  distributions 
Frequency  distributions  of  priority  scores 
Institute  assignment 

Number  of  applications 

Study  section  actions:  Disapproval/NRFC,  score  distributions 
Difference  in  mean  priority  scores,  FY1983  - 1992 


Competing  R01  Applications*  Reviewed  by  DRG  Study  Sections 
by  Priority  Score  Interval  and  Type,  FY1983-1992t 


100-175 


■ 176-225  0 226-275 


E3  276-500  □ Disapproved/ 

NRFC** 


Percent 

100-^ 


75- 


50- 


15.1 


29.5 


xx/xxxx- 

xxxxxxx 

x/xxxxx, 

✓xxxxxx, 

: 17.7 


xxxx/xx 

x/xxxxx 

x/xxxxx 


New  Applications 


xxxxxxx 

xxx/xxx 

xxxxxxx 

'XXXX/XX 

xxxxxxx 

xxxxxxx 

xxx/xxx 

'XXXXXXX 

'XXXXXXX 

'XXXXXXX 

'XXXXXXX 

xxxxxxx 


/xxxxxxx 

<^xxxxxxx 

/xxxxxxx 

/xxxxxxx 

/xxxxxxx 

/xxxxxxx 

/xxxxxxx 

/xxxxxxx 

/xxxxxxx 

/xxxxxxx 

/xxxxxxx 

/xxxxxxx 


xxxxxxxx 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 

xxxxxxx/ 


xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

■xxxxxxx. 


: 26.9 


13.9 


'■xxxxxxx 
xxxxxxx 
xxxxxxx 
* * **  - 

P;18.5 


xxxxxxx. 

xxxxxxx. 

xxxxxxx. 

xxxxxxx. 


■ ^ Mssm  ' — 

OHI 

1983  1985  1987  1989  1991  1992 


Percent 


Competing  Continuations 


1983  1985  1987  1989 


1991  1992 


Mean:  287  267  254  270  254  280  216  199  189  213  203 

* Original  and  amended  applications  summarized  by  fiscal  year  of  initial  review;  excludes  withdrawals  and  supplements. 

‘‘Beginning  with  FY1992,  "not  recommended  for  further  consideration  (NRFC)"  was  used  and  the  category  "disapproved"  was  dropped, 
t Selected  years. 

Source;  NIH,  DRG,  ISB,  SAES 


216 

7/1 1/94 
W16cg3 
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3.  ,^>plication  Characteristics  (ROl)  Related  to  Study  Section  Action 


The  proportion  of  new  and  competing  continuation  ROl  applications  disapproved  by  DRG  study  sections  declined  from  FY1983  to 
FY1991.  The  number  of  applications  not  rated  rose  again  with  the  advent  of  the  NRFC  classification.  The  proportion  of  disapproved 
new  apphcations  fell  by  11.9  percentage  points  from  1983  to  1991.  Competing  continuations,  all  of  which  have  won  funding  in  a previ- 
ous round,  had  2.4  percent  fewer  disapprovals  between  1983  and  1991.  In  1991,  only  0.5  percent  of  applications  for  competing  continua- 
tion were  disapproved,  while  3.2  percent  of  new  applications  were  disapproved. 

From  1983  to  1987,  the  proportion  of  both  new  and  competing  continuation  apphcations  scoring  100-175  rose  steadily.  Through  1987, 
ROl  competing  continuations  showed  an  especiaUy  large  increase  in  the  proportion  with  these  scores  - a 14.3  percentage  point  increase, 
compared  to  an  increase  of  7 points  on  new  apphcations.  Competing  continuations  have  won  funding  previously,  and  can  be  expected 
to  have  a high  proportion  of  good  scores.  Not  surprisingly,  competing  continuation  trends  correspond  to  the  trends  seen  in  the  last 
chapter  for  ROl  apphcations:  proportions  in  the  good  range  increased  through  1987,  dropped  in  1988  and  1989,  and  showed  growth 
through  1991.  Mean  priority  scores  also  mirror  this  trend. 


Please  note  that  the  reviewed  mean  priority  scores,  unlike  the  statistics  based  only  on  approved  apphcations,  include  disapprovals  as  if 
they  had  a priority  score  of  501.  In  combination  with  the  effects  of  the  NRFC  change  shown  elsewhere,  this  probably  accounts  for  the 
26-point  rise  in  mean  priority  scores  for  new  apphcations  in  1992. 


Number 

Reviewed 


Percentage 

Disapproved 


Percentage 
100-175 


Reviewed 
Mean  score" 


Approved 
Mean  score 


Approved 
Median  score 


Competing 

Competing 

Competing 

Competing 

Competing 

Competii 

New 

Cont . 

New 

Cont . 

New 

Cont . 

New 

Cont . 

New 

Cont . 

New 

Cont 

1983.  . . 

, . . .10,549 

4,382 

15.1 

2.9 

22.0 

41.6 

287 

216 

249 

208 

241 

189 

1984.  . . 

11,123 

4,498 

13.7 

2.3 

22.9 

48.1 

282 

208 

247 

201 

236 

177 

1985.  . . 

11,736 

4,682 

10.0 

1.8 

25.5 

52.2 

267 

199 

241 

194 

229 

170 

1986.  . . 

10,019 

5,250 

7.9 

0.9 

28.5 

55.5 

256 

190 

235 

188 

221 

166 

1987. . . 

8,648 

5,080 

7.0 

0.9 

29.0 

55.9 

254 

189 

235 

187 

219 

165 

1988. . . 

8,953 

4,928 

5.4 

0.7 

24.3 

50.7 

262 

198 

248 

196 

235 

174 

1989.  . . 

10,746 

5,125 

3.3 

0.5 

19.0 

38.9 

270 

213 

262 

211 

250 

195 

1990.  . . 

10,872 

5,103 

2.7 

0.3 

22.4 

43.6 

259 

205 

252 

204 

238 

187 

1991. . . 

9,674 

5,176 

3.2 

0.5 

24.9 

45.1 

254 

203 

246 

201 

232 

184 

1992.  . . 

10,798 

5,192 

13.9 

3.8 

20.6 

41.2 

280 

216 

244 

205 

232 

187 

Change 

(1983-88) 

-1,596 

+546 

-9.7 

-2.2 

+2.3 

+9.2 

-25 

-19 

-1 

-12 

-6 

-15 

Change 

(1988-93) 

+1,845 

+264 

8.5 

3.1 

-3.7 

-9.5 

+18 

+18 

-4 

+ 11 

-3 

+13 

Percentage  of  reviewed  apphcations  by  fiscal  year  of  IRG  review. 
Includes  disapprovals  as  if  they  had  a priority  score  of  501. 
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Priority-Score  Distributions  of  Competing  R01  Appiications* 
Rated  by  DRG  Study  Sections,  FY1983,  1988,  1992 


Percent 
40 


30 


20- 


10- 


New  Applications 


> 300^ 


— 1992 

- 23.7% 

iiiiiiiOoiiiii  1 988 

- 26.4% 

■■■oiii  1983 

- 26.9% 

— I 1 1 1 1 1 1 1 — 

100-  126-  151-  176-  201-  226-  251-  276- 

125  150  175  200  225  250  275  300 


Percent 
40 


30- 


20 


10- 


Competing  Continuations 

> 300** 
1992  - 10.2% 
8.7% 


a 

9 9. 


iiiiiiiiO<iiiii>  1988 

iiiiDiii  1983  - 10.8% 


T 1 1 1 i T 

100-  126-  151-  176-  201-  226-  251-  276- 

125  150  175  200  225  250  275  300 


‘Summarized  by  fiscal  year  of  initial  review;  excludes  withdrawals  and  supplements. 
"Distribution  of  scores  over  300  not  shown. 

Source:  NIH,  DRG,  ISB,  SAES 


12/30/93 
W1 8cg3 
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3.  .^jplication  Characteristics  (ROl)  Related  to  Study  Section  Action 


! 

i 

j While  the  general  shapes  of  the  DRG-reviewed,  new  ROl  application  priority  score  distributions  from  1983, 1988,  and  1992  are  very  simi- 
lar, they  differ  markedly  from  their  corresponding  competing  continuation  ROl  priority  score  distributions.  Consistent  with  the  percentile 
j score  distributions  seen  elsewhere,  competing  continuation  applications  are  much  more  likely  to  have  received  lower  (better)  scores. 

j From  1983  to  1987,  mean  priority  scores  of  DRG-reviewed  amended  new  and  competing  continuation  ROl  applications  declined  (i.e., 

were  rated  more  favorably).  In  part,  this  was  probably  due  to  the  amendment  of  high-scoring  applications  that,  in  earlier  years,  would 
have  been  funded.  In  1989,  all  priority  scores,  amended  or  not,  rose.  Most  likely,  this  reflects  percentUing,  standardized  adjectives  with 
score  ranges,  and  encouragement  of  greater  score  dispersion.  By  1992,  scores  had  once  again  declined. 

Initially,  amended  competing  continuations  had  poorer  average  scores  than  nonamended  competing  continuations;  this  gap,  however, 
slightly  narrowed  and  reversed.  Since  1983,  mean  scores  of  competing  continuations  without  amendments  increased  (worsened)  by  2 
points,  but  scores  of  competing  continuations  with  amendments  declined  by  12  points. 


New  Applications Competing  Continuations 


Excluding 

Including 

Excluding 

Including 

Amendments 

Amendments 

Diff . 

Amendments 

Amendments 

Diff 

1983 

.254 

234 

-20 

204 

216 

-1-12 

1985 

. 246 

226 

-20 

191 

201 

-1-10 

1987 

. 242 

217 

-25 

185 

190 

-1-5 

1989 

. 271 

240 

-31 

208 

217 

-1-9 

1991 

.260 

219 

-41 

202 

200 

-2 

1992 

.255 

219 

-36 

206 

204 

-2 

Change  (1983-89) 

-1-17 

+6 

+4 

+1 

Change  (1989-92) 

-16 

-21 

-2 

-13 
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Mean  Priority  Scores  of  Competing  R01  Applications* 
Rated  by  DRG  Study  Sections,  FY1 983-1 992 


Mean  Score 


’Summarized  by  fiscal  year  of  initial  review;  excludes  withdrawals  and  supplements. 
Source:  NIH,  DRG,  ISB,  SAES 


7/1 1/94 
W20cg3 


3.  ,^>plication  Characteristics  (ROl)  Related  to  Study  Section  Action 


Scores  in  the  100-175  range  declined  slightly  for  new  ROl  apphcations,  and  remained  steady  for  competing  continuation  ROl’s  between 
1983  and  1992.  As  the  chart  suggests,  though,  there  was  a peak  in  1989  for  all  apphcations  yielding  a smaUer  proportion  in  the  100-175 
range.  For  instance,  the  proportion  of  new  apphcations  with  126-150  scores  dropped  from  9.7  percent  in  1983  to  7.4  in  1989  and  rose 
to  10.4  percent  in  1992.  In  paraUel,  new  apphcations  with  151-175  scores  dropped  from  14.6  to  11.2  and  rose  shghtly  to  11.9  percent 
in  1992.  Competing  continuation  apphcations  with  126-150  scores  also  declined  a httle  from  16.7  in  1983  to  16.4  percent  in  1989  and 
rose  to  20.1  percent  in  1992.  Similarly,  competing  continuations  with  151-175  scores  declined  from  22.0  in  1983  to  20.0  percent  in  1989, 
but  also  dropped  to  18.7  percent  by  1992.  As  seen  elsewhere,  these  data  continue  to  reflect  the  preponderance  of  competing  continuation 
ROl  apphcations  in  the  score  region  below  150. 

From  1983  to  1992  there  were  some  changes  in  the  proportion  of  apphcations  with  poorer  scores  (greater  than  300).  These  changes 
were  the  converse  of  those  in  the  better  score  regions;  i.e.,  in  1989,  their  percentage  rose  (roughly  31  percent  for  new  apphcations,  11 
percent  for  competing  continuations).  But  by  1992,  both  new  apphcations  and  competing  continuations  were  showing  smaUer  percentages 
in  the  poorer  score  region. 


New  Applications  Competing  continuations 


Scores 

1983 

1989 

1992 

1983 

1989 

1992 

100-125 

1.6 

1.1 

1.6 

4.0 

2.7 

3.9 

126-150. . . 

9.7 

7.4 

10.4 

16.7 

16.4 

20.1 

151-175. . . 

14.6 

11.2 

11.9 

22.0 

20.0 

18.7 

176-300 

47.2 

49.5 

52 . 3 

46.6 

49.9 

47.0 

>300 

26.9 

30.8 

23.8 

10.7 

11.0 

10.3 

Total . . 

100.0 

100.0 

100.0 

100.0 

100.0 

100.0 

No . * 

8,955 

10,388 

10,798 

4,253 

5,098 

4,997 

Mean 

249 

262 

244 

208 

211 

205 

Median. . . . 

241 

250 

232 

189 

195 

187 

Std.  Dev. . 

85.4 

89.0 

81.9 

69.1 

69.1 

68.6 

Coeff .Var . 

34.3 

34.0 

33.6 

33.2 

32.7 

33.5 

*Approved  apphcations  by  fiscal  year  of  IRG  review. 

The  dispersion  of  scores  about  the  mean  as  measured  by  the  standard  deviation  has  decreased  since  1983;  however,  there  is  httle  change 
if  score  variabhity  is  expressed  as  a percentage  of  the  mean  (coefficient  of  variation  or  C.V.). 
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Success  Rates  for  DRG-Reviewed  Competing  R01  Applications* 
by  Type  and  Amendment  Status,  FY1 983-1 992 


New  Applications  ^ ^ Competing  Continuations 


42 


‘Competing  applications  summarized  by  requested  start  date  or  fiscal  year  of  funds  from  the  success  rate  file. 
Source:  NIH,  DRG,  ISB,  SAES 


6/27/94 

W58cg3 


3.  implication  Characteristics  (ROl)  Related  to  Study  Section  Action 


In  parallel  with  the  impact  of  amendments  on  mean  priority  scores,  the  funding  prospects  for  amended  applications  are  historically  consis- 
tent. It  is,  however,  inappropriate  to  infer  that  amended  applications  are  always  the  most  successful  in  receiving  awards.  As  the  graph 
and  table  suggest,  the  success  rate  of  competing  continuations  has  consistently  been  higher  than  that  of  new  appUcations.  It  is  nonamend- 
ed  competing  continuations  which  enjoy  the  greatest  prospects  for  funding  while  nonamended  new  applications  suffer  the  poorest  pros- 
pects. These  data  also  suggest  that  those  submitting  amended  new  applications  wiU  probably  improve  their  chances  of  funding,  but  that 
two  amended  submissions  is  a limit  of  effectiveness.  (New  appUcations  with  more  than  two  amendments  are  stiU,  however,  more  success- 
ful than  unamended  new  appUcations.)  Those  submitting  amended  competing  continuations  wiU  be  more  Ukely  to  receive  funding  than 
amended  new  appUcations,  but  wiU  remain  less  successful  than  nonamended  competing  continuations. 

Success  Rates 

More  than  Two 


NonAmended 

One  Amendment 

Two  Amendments 

Amendments 

Year 

New 

Competing 

Continuation 

New 

Competing 

Continuation 

New 

Competing 

Continuation 

New 

Competing 

Continuation 

1983 

23.6 

50.9 

29.2 

41.9 

25.2 

38.7 

25.6* 

46.2* 

V' 

1984 

22.7 

54.1 

30.1 

37.7 

28.0 

36.2 

32.1 

20.7* 

1985 

22.7 

56.3 

28.7 

46.3 

27.0 

40.2 

30.2 

24.0 

1986 

21.5 

53.9 

29.3 

40.4 

33.5 

37.9 

27.9 

35.2 

"'i 

1987 

23.1 

57.3 

30.4 

45.9 

35.1 

43.6 

37.9 

39.1 

1988 

20.9 

55.0 

27.3 

42.8 

31.1 

41.5 

30.4 

31.3 

j 1 

1989 

17.7 

46.2 

21.2 

33.1 

25.6 

34.2 

20.2 

23.2 

.1. 

1990 

13.2 

38.0 

21.2 

29.7 

27.4 

31.8 

23.3 

24.6 

1991 

16.0 

41.8 

27.3 

36.7 

32.0 

45.3 

31.4 

39.7 

1992 

15.7 

43.6 

29.1 

39.1 

35.1 

36.6 

32.8 

38.8 

*Rate  based  on  fewer  than  50  observations. 
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Distribution  of  DRG-Reviewed  Competing  R01  Appiications* 
by  Requested  Years  of  Support,  FY1983  and  FY1992 


E3  5 or  more  yrs**  li  4 years 


3 years 


Percent  Total  New 


Number:  11,547  10,726 

Avg.  Yrs.:  3.5  4.1 


8,401  7,621 

3.2  3.9 


M 1,  2 years 


Competing 

Continuation 


— I — 

1983  1992 

3,146  3,105 

4.0  4.6 


*Summarized  by  fiscal  year  of  initial  review;  excludes  amendments,  withdrawals  and  supplements. 
“Includes  less  than  2%  requesting  6 or  more  years. 

Source:  NIH,  DRG,  ISB,  SAES 


7/1 1/94 
W23cg3 


3.  Application  Characteristics  (ROl)  Related  to  Study  Section  Action 


Since  1983,  the  primary  change  in  the  requested  years  of  support  for  ROl  applications  has  been  a decHne  in  requests  for  either  1 or  2 
years  of  support  and  an  increase  in  requests  for  5 or  more  years  of  support.  Requests  for  1 or  2 years  dropped  from  1 1 percent  to  5 per- 
cent of  new  applications  and  from  2 percent  to  1 percent  of  competing  continuations.  By  1992,  the  nmnber  of  years  requested  for  new 
and  competing  continuation  applications  had  shifted  from  shorter  (particularly,  the  3-year  category)  to  longer  durations.  The  most  com- 
monly requested  duration  was  5 years  of  support. 

New  appHcations  differ  from  competing  continuations  in  the  proportions  requesting  various  numbers  of  years.  In  1992,  41  percent  of 
the  new  appHcations  requested  5 or  more  years  of  NIH  support;  17  percent  requested  4 years;  37  percent  requested  3 years;  and  5 percent 
requested  1 or  2 years.  Competing  continuation  appHcations  showed  a somewhat  similar  ordering,  but  an  altogether  different  set  of  pro- 
portions. Almost  70  percent  of  1992  competing  continuations  requested  5 or  more  years  of  support;  17  percent  requested  4 years;  12 
percent  requested  3 years;  and  only  1 percent  requested  1 or  2 additional  years.  Since  new  appHcations  outnumber  competing  continua- 
tions by  more  than  two  to  one,  the  total  ROl  distribution  more  closely  resembles  that  of  the  new  appHcations.  Nearly  50  percent  of  aU 
1990  appHcations  requested  5 or  more  years,  foUowed  by  30  percent  requesting  3 years. 

The  graphed  data  exclude  aU  amendments,  in  order  to  present  a clear  picture  of  requests  for  support. 


Number  Reviewed 


Nonamendments 


Amendments  (%) 


1983 

1992 

1983 

1992 

1983 

1992 

Years  Reauested 

New 

1 & 

2 

1,110 

423 

934 

349 

176 

(15.9) 

74 

(17.5) 

Applications 

3 

7,145 

4,137 

5,598 

2,820 

1,547 

(21.7) 

1,317 

(31.8) 

4 

719 

1,893 

554 

1,299 

165 

(22.9) 

594 

(31.4) 

more 

than 

4.  . .1,575 

4,344 

1,315 

3,153 

260 

(16.5) 

1,191 

(27.4) 

Competing 

1 & 

2 

81 

45 

61 

29 

20 

(24.7) 

16 

(35.6) 

continuations 

3 

2,034 

917 

1,282 

379 

752 

(37.0) 

538 

(58.7) 

4 

479 

966 

350 

535 

129 

(26.9) 

431 

(44.6) 

more 

than 

4.  . .1,788 

3,264 

1,453 

2,162 

335 

(18.7) 

1,102 

(33.8) 

*By  fiscal  year  of  IRG  review. 
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Mean  Priority  Scores  of  Competing  R01  Appiications* 
by  Requested  Years  of  Support,  FY1 975-1 992 


Mean  Score 


46 


‘Includes  original  and  amended  applications  summarized  by  fiscal  year  of  DRG  study  section  review;  excludes 
withdrawals  and  supplements.  “Competing  continuations  requesting  one  or  two  years  of  support  omitted  due  to  smail  number. 
Source:  NIH,  DRG,  ISB,  SAES 


7/1 1/94 
W22cg3 


3.  ^plication  Characteristics  (ROl)  Related  to  Study  Section  Action 


Applicants  requesting  5 or  more  years  of  support  receive  much  better  scores  than  those  requesting  fewer  years,  whether  they  are  seeking 
new  or  competing  continuation  ROl  funding.  Poorest  average  scores  are  found  on  applications  requesting  support  for  only  1 or  2 years. 
The  many  applications  seeking  3 years  of  support  fall  between  these  two  extremes.  This  relationship  between  scores  and  requested  years 
of  support  holds  in  every  year  since  1975. 

Along  with  Council  and  Institute  concerns,  priority  scores  (and  their  percentiles)  form  the  basis  for  the  success  of  applications.  To  the 
extent  that  longer  term  projects  receive  better  priority  scores,  they  have  a higher  probability  of  funding.  In  1990,  success  rates  for  both 
new  and  competing  continuation  appHcations  seeking  5 or  more  years  of  support  were  considerably  higher  than  those  seeking  1 or  2 years 
of  support.  In  1992,  success  rates  ranged  from  9 percent  (one-to-two  years  requested)  to  a high  of  22  percent  (more  than  four  years  re- 
quested) on  new  applications  and  from  36  (one-to-two  years  requested)  to  41  percent  (more  than  four  years  requested)  on  competing 
continuations.  While  success  rates  for  new  appHcations  have  continued  to  be  worse  than  those  for  competing  continuations,  it  is  also 
worth  noting  that  the  historically  better-than-even  odds  for  success  of  competing  continuation  appHcations  requesting  more  than  four 
years  dropped  to  46  percent  in  1988  and  continued  to  decline  to  41  percent  in  1992. 


Mean  Scores*  Success  Rates** 

Years  Requested  Years  Requested 


Year 

1&2 

3 

4 

>4 

1&2 

3 

4 

>4 

1983 . . . 

. . .282 

251 

242 

227 

13 

23 

26 

32 

New 

1985. . . 

. . .287 

240 

241 

224 

14 

22 

23 

30 

Applications 

1987.  . . 

. . .282 

239 

232 

220 

15 

22 

25 

30 

1989.  . . 

. . .319 

270 

259 

245 

9 

15 

17 

23 

1991. . . 

. . .311 

261 

241 

229 

11 

15 

21 

22 

1992  . . . 

. . .292 

256 

241 

231 

9 

15 

21 

22 

1983-92 . . . 

. . .-HO 

-1-5 

-1 

-1-4 

-4 

-8 

-5 

-10 

1983.  . . 

. . .228 

220 

209 

193 

46 

37 

45 

56 

Competing 

1985. . , 

. . .224 

206 

194 

181 

26 

41 

49 

59 

Continuations 

1987.  . . 

. . .225 

201 

192 

178 

53 

38 

45 

55 

1989.  . . 

. . .214 

233 

223 

202 

31 

25 

30 

43 

1991. . . 

. . .241 

221 

209 

195 

26 

25 

33 

40 

1992.  . . 

. . .237 

224 

208 

198 

36 

28 

33 

41 

1983-92. . . 

. . . +9 

-1-4 

-1 

+5 

-10 

-9 

-12 

-15 

By  fiscal  year  of  IRG  review. 

Initial  & amended  appHcations  by  fiscal  year  of  funds  or  requested  start  date. 


47 


DRG  Study  Section  Score  Distribution  of  Competing  R01  Appiications* 
by  Requested  Years  of  Support,  FY1983,  1988,  1992 


Percent  1-2  Years 


3-4  Years 


75- 


50- 


25- 


5 or  more  Years 

Disapproved/ 

-■  ‘^NRFC 


176  - 500 


151  - 175 


100-150 


Number: 

(thous.) 


1983  1988  1992 

1.2  0.6  0.5 


1983  1988  1992 

10.4  7.0  7.9 


1983  1988  1992 

3.4  6.3  7.6 


‘Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review;  excludes 
withdrawals  and  supplements. 

Source:  NIH,  DRG,  ISB,  SAES 


12/30/93 

W24cg3 


3.  .^jplication  Characteristics  (ROl)  Related  to  Study  Section  Action 


ROl  applications  with  different  requested  years  of  support  have  dramatically  different  priority-score  distributions,  and  are  also  rated  quite 
differently.  Requests  for  5 or  more  years  of  support  are,  proportionally,  rated  more  frequently  and  have  lower  (better)  priority  scores 
than  do  requests  for  3 or  4 years.  The  latter  are  rated  more  frequently,  and  better  than  requests  for  only  1 or  2 years.  In  1992,  the  pro- 
portions rated  ranged  from  61  percent  of  new  appHcants  seeking  1 or  2 years  to  97  percent  of  those  seeking  5 or  more  years  of  competing 
continuation  support.  Differences  are  most  pronounced  for  new  appHcations;  as  expected,  appUcations  for  competing  continuation  are 
more  frequently  rated  in  all  groups. 


Percentage  Percentage 

Rated with  Scores  100-175* 

Years  Requested  Years  Requested 


1&2 

3&4 

>4 

1&2 

3&4 

>4 

1983.  . . 

. . .68.3 

88.9 

94.2 

14.4 

24.4 

42.7 

Total 

1988. . . 

...85.1 

95.4 

98.4 

15.6 

26.2 

43.8 

1992.  . . 

...63.5 

86.6 

93 . 9 

9.6 

21.5 

34.3 

1983-92 

-5.2 

-2.3 

-0.3 

00 

T 

CM 

• 

CO 

New 

1983  . . . 

. . .66.5 

86.6 

89.3 

12.8 

21.5 

30.8 

Applications 

1988. . . 

...83.6 

94.4 

97.1 

12.5 

22 . 1 

30.1 

1992  . . . 

...60.8 

84 . 1 

91.3 

7 . 1 

17.9 

25.6 

1983-92 

-5.7 

-2 . 5 

+2 . 0 

-5.7 

-3 . 6 

-5.2 

Competing 

1983.  . . 

...92.6 

96.2 

98.5 

35.8 

33 . 5 

53.2 

Continuations 

1988. . . 

...97.1 

98.8 

99.6 

34.7 

39.5 

56.7 

1992  . . . 

CO 

CO 

94 . 5 

97 . 4 

33 . 3 

33.2 

45.9 

1983-92 

-3.7 

-1.7 

-1.1 

-2.5 

-0.3 

-7.3 

*Based  on  reviewed  applications  by  fiscal  year  of  IRG  review. 

Since  1983,  aU  three  years-requested  groups  have  shown  a slight  increase  and  then  a decline  in  the  proportion  of  ROl  applications  with 
scores  in  the  100-175  range.  Those  requesting  5 or  more  years  have  declined  the  most  — from  42.7  percent  to  34.3  percent  of  reviewed 
appHcations,  or  a decrease  of  8.4  percentage  points.  This  is  much  steeper  than  the  4.8  percentage  point  decline  for  those  requesting  1 
or  2 years.  And,  while  those  requesting  3 or  4 years  of  support  in  1992  had  but  21.5  percent  of  their  appHcations  in  the  100-175  range, 
this  was  only  a drop  of  2.9  percentage  points  from  1983.  Percentages  rated  aU  tend  to  show  an  inverted-v  shape,  coincident  with  the 
pattern  of  much  lower  priority  scores  in  1988. 
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Percent 


Priority  Score  Distributions  of  DRG-Rated  R01  Applications* 
by  Requested  Years  of  Support,  FY1992 


‘Includes  original  and  amended  applications  summarized  by  fiscal  year  of  DRG  study  section  review; 
excludes  withdrawals  and  supplements. 

Source:  NIH,  DRG,  ISB,  SAES 


6/1 4/94 
W26cg3 


3.  Application  Characteristics  (ROl)  Related  to  Study  Section  Action 


As  seen  in  the  prior  pages,  applications  with  different  requested  years  of  support  have  strikingly  different  priority  score  distributions. 
Of  the  7,141  approved  applications  requesting  5 or  more  years  of  support  in  1992,  20.7  percent  received  scores  of  150  or  better  --  well 
above  the  11.9  percent  on  apphcations  requesting  3 or  4 years,  and  more  than  twice  the  8.7  percent  on  apphcations  requesting  1 or  2 
years. 


Priority  Score  Frequency  Distribution  Percentages 


1983 


1992 


Year  Requested  Years  Requested 


Scores 

1.2 

3.4 

>4 

1.2 

3.4 

>4 

100-125. . 

2.1 

1.5 

4.9 

2.0 

1.4 

3.4 

126-150. . 

9.2 

9.4 

20.0 

6.7 

10.5 

17.3 

150-175. . 

9.7 

16.5 

20.5 

6.4 

13 . 0 

15.9 

176-200. . 

. . . , 7.3 

10.8 

11.2 

8.4 

12 . 3 

13 . 7 

201-300. . 

30.8 

38 . 7 

30.9 

33 . 3 

39.5 

35.9 

>300. . 

41.0 

23 . 1 

12 . 5 

43 . 1 

23 . 3 

13.9 

Total . . . 

. . . 100.0 

100.0 

100.0 

100.0 

100.0 

100.0 

Number* . 

813 

9,228 

3 , 167 

297 

6,853 

7,141 

Mean 

277 

242 

208 

284 

242 

217 

Median. . . 

273 

231 

184 

280 

230 

200 

St.  dev. 

....98.2 

81.3 

74.4 

97.0 

81.2 

74 . 5 

C.V.  . . . o 

• • • • 3 5 • 5 

33 . 6 

35.8 

34.2 

33.6 

34.3 

*Rated  apphcations  by  fiscal  year  of  IRG  review. 


Apphcations  requesting  5 or  more  years  of  support  include  a much  higher  proportion  of  competing  continuations  than  the  other  two  years- 
requested  groups.  Nevertheless,  the  number  of  years  requested  bears  a strong  relationship  to  the  scores  of  both  new  and  competing 
continuation  apphcations.  It  is  also  worth  noting  that  the  proportions  within  each  priority  score  interval  remain  relatively  constant. 
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Number  of  Competing  DRG-Reviewed  R01  Applications* 
by  Assigned  Institute,  FY1983  Versus  FY1992 


Number 


m FY1983  m FY1992 


NCI  NIGMS  NHLBI  NIAID  NIDDK  NINDS  NICHD  NEI  NiAMS  NIA  NIEHS  NIDCD  NIDR  NCNR  NCHGR 


‘Excludes  withdrawls  and  supplements.  Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review. 
Source:  NIH,  DRG,  ISB,  SAES 


7/1 1/94 
W27cg3 


3.  implication  Characteristics  (KOI)  Related  to  Study  Section  Action 


The  National  Cancer  Institute  (NCI)  ranked  first  in  the  number  of  1992  DRG-reviewed  ROl  applications  - about  15  percent  of  the  NIH 
total.  NCI  also  ranked  first  in  1983  with  19.1  percent  of  the  NIH  total,  but  its  applications  declined  the  most  from  1983  to  1992,  both 
by  count  (373)  and  percent  (12.9).  The  National  Institute  of  General  Medical  Sciences  (NIGMS)  remained  a major  referral  with  14.5 
percent,  and  the  National  Heart,  Lung,  and  Blood  Institute  (NHLBI,  the  third-ranked  Institute)  stayed  even  with  the  general  growth  in 
applications.  The  National  Centers  for  Human  Genome  Research  (NCHGR)  and  Nursing  Research  (NCNR)  were  relative  newcomers  to 
NIH.  They,  and  the  National  Institutes  of  Arthritis  and  Musculoskeletal  and  Skin  Diseases  (NIAMS),  Environmental  Health  (NIEHS),  Den- 
tal Research  (NIDR),  Aging  (NIA),  Deafness  and  Other  Communication  Disorders  (NIDCD)  and  the  Eye  Institute  (NEI)  were  each  assigned 
less  than  5 percent  of  the  total  DRG-reviewed  ROl  applications  in  1992.  Perhaps  m response  to  the  HIV  epidemic,  the  number  of  apphca- 
tions  assigned  to  the  Institute  of  Allergy  and  Infectious  Diseases  (NIAID)  experienced  the  largest  absolute  increase  over  the  period  (386). 
The  Eye  Institute  has  consistently  had  a large  proportion  of  competing  continuation  applications  — 42  percent  in  1983  and  46  percent 
in  1990.  Many  Institutes  experienced  increases  in  their  competing  continuation  application  percentage. 

^ Change  Percentage 

No . Reviewed  No. %_  Competing  continuation 


1983 

1992 

1983 

-1992 

1983 

1992 

NCHGR 

- 

106 

+ 106 

- 

- 

14.2 

NCNR 

- 

134 

+ 134 

- 

- 

17.9 

NIDR 

288 

307 

+19 

+6 . 6 

40.3 

34.2 

NIDCD 

230 

378 

+ 148 

+64.3 

28.3 

24.3 

NIEHS 

254 

404 

+ 150 

+59.1 

26.8 

23.8 

NIA 

623 

590 

-33 

-5.3 

17.8 

17.8 

NIAMS 

226 

610 

+384 

+169.9 

32.7 

26.2 

NEI 

564 

699 

+ 135 

+23.9 

42.2 

45.9 

NICHD 

1,441 

1,252 

-189 

-13.1 

21.6 

62.7 

NINDS 

1,460 

1,556 

+96 

+6.6 

27.5 

38.0 

NIDDK 

1,775 

1,612 

-163 

-9.2 

36.5 

37.6 

NIAID 

1,335 

1,721 

+386 

+28.9 

28.4 

32.0 

NHLBI 

1,837 

1,976 

+139 

+7.6 

28.7 

31.7 

NIGMS 

2,185 

2,358 

+173 

+7.9 

35.1 

37.2 

NCI 

2.881 

2.508 

-373 

-12.9 

26.5 

27.8 

Minimum. . 

. 226 

106 

-373 

-12.9 

17.8 

14.2 

Maximum. . 

.2,881 

2,508 

+386 

+169.9 

42.2 

62.7 

*By  fiscal  year  of  IRG  review;  Institutes  ranked  by  the  munber  reviewed  in  1992. 

DRG’s  Referral  and  Review  Branch  assigns  competing  applications  to  the  appropriate  NIH  Institute  and  DRG  study  section  or  Institute 
initial  review  group.  Assignments  are  based  on  each  Institute’s  overall  mission  and  specific  program  interests. 
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DRG  Study  Section  Action  on  Competing  R01  Applications^ 

by  Assigned  Institute,  FY1992 


NIA 

NCNR 

NEI 

NCHGR  NIEHS 

NICHD 

NIDDK 

NIDCD 

NINDS 

NCI 

NHLBI 

NIDR 

NIAMS 

NIAiD 

NIGMS 

590 

134 

699 

106  404 

1,252 

1,612 

378 

1,556 

2,508 

1,976 

307 

610 

1,721 

2,358 

Note:  Ranked  by  percent  of  rated  applications  scored  100-175. 

*lncludes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review.  Excludes  withdrawals  and  supplements. 
**Not  recommended  for  further  consideration. 

Source:  NIH,  DRG,  ISB,  SAES 


12/30/93 

W29cg3 
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3.  ^plication  Characteristics  (ROl)  Related  to  Study  Section  Action 


The  different  Institutes  have  significantly  different  distributions  of  ROl  priority  scores.  For  example,  in  1983,  about  40  percent  of  the 
NIDCD  applications  received  scores  of  175  or  better  - more  than  double  the  proportion  with  these  scores  on  NIEHS  appHcations.  Such 
priority  score  differences  among  Institutes  appear  in  both  new  and  competing  continuation  apphcations.  The  Institutes  also  differ  in  the 
amount  of  priority  score  change  they  have  experienced  since  1983,  with  NIEHS  and  NHLBI  showing  the  largest  increases  in  the  proportion 
of  apphcations  scored  100-175.  NIDCD  and  NEI  showed  the  largest  declines  in  proportions  in  this  score  range. 

Percentage  Scored  100-175* 


Total 

New 

Comoetina 

contin 

1983 

1992 

Diff . 

1983 

1992 

1983 

1992 

NIA 

.21.0 

16.0 

-5.0 

20.4 

15.3 

23.0 

35.4 

NCNR** 

- 

17.2 

- 

- 

21.8 

- 

22.3 

NEI 

.29.8 

17.6 

-12.2 

27.6 

14.0 

32.8 

26.0 

NCHGR** 

- 

19.8 

- 

- 

29.8 

- 

46.7 

NIEHS. . 

.18.1 

21.8 

+3.7 

11.9 

21.8 

33.9 

38.3 

NICHD. . 

.28.5 

24.0 

-4.5 

25.0 

20.7 

39.7 

40.5 

NIDDK. . 

.31.2 

24.7 

-6.5 

24.6 

20.9 

41.7 

38.1 

NIDCD. . 

.40.2 

24.8 

-15.4 

32.1 

22.8 

57.1 

47.6 

NINDS. . 

.32.6 

25.3 

-7.3 

27.3 

22.1 

44.8 

37.5 

NCI 

.28.5 

25.3 

-3 . 2 

22.8 

22.6 

42.3 

44.6 

NHLBI . . 

.25.5 

25.5 

0.0 

20.5 

23.5 

36.8 

40.4 

NIDR. . . 

.29.0 

26.1 

-2.9 

30.0 

22 . 0 

27.7 

42.0 

NIAMS. . 

.35.4 

30.3 

-5.1 

25.8 

29.1 

52.1 

47.6 

NIAID. . 

.37.3 

34 . 0 

-3 . 3 

31.9 

32.3 

50.5 

49.4 

NIGMS . . 

.39.7 

34.5 

-5.2 

33 . 1 

28.1 

51.0 

53.2 

Minimum. . 

.18.1 

16.0 

-2.1 

11.9 

14.0 

23.0 

22.3 

Maximum. . 

.40.2 

34.5 

-5.7 

33 . 1 

32.3 

57.1 

53.2 

*Based  on  rated  apphcations  by  fiscal  year  of  IRG  review. 
**Did  not  exist  in  1983. 


Most  Institutes’  apphcations  are  reviewed  by  several  study  sections.  Since  priority-score  distributions  (and  means)  differ  from  one  study 
section  to  another.  Advisory  Councils/Boards  and  Institute  staff  now  use  the  percentile  rank  of  each  apphcation  within  its  study  section 
to  make  funding  decisions. 
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Mean  Priority  Scores  of  DRG-Rated  R01  Applications* 

by  Assigned  Institute 

m FY1992  FY1983 


Mean  Score 


Note:  Ranked  by  FY1 992  mean  scores. 

‘Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review.  Excludes  withdrawals  and  supplements. 

Source:  NIH,  DRG,  ISB,  SAES  W31cg3 
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3.  Application  Characteristics  (ROl)  Related  to  Study  Section  Action 


In  1992,  mean  priority  scores  ranged  from  214  on  competing  ROl  applications  assigned  to  NIAID  to  269  on  applications  for  NCNR.  Al- 
though there  have  been  some  exceptions  and  year-to-year  variation,  Institute-by-Institute  rankings  on  mean  priority  scores  have  remained 
remarkably  similar  since  1983.  Decision  making  has  shifted  to  percentiles,  but  these  mean  priority  scores  show  the  historical  trends. 


New,  competing  continuation,  and  apphcations  excluding  amendments  have  followed  a similar  ranking  pattern.  Factors  that  are  related 
to  overall  scores,  such  as  the  number  of  requested  years  of  support  or  whether  an  apphcation  is  from  a basic  or  clinical  department,  are 
not  beheved  to  have  been  the  primary  cause  of  Institute  differences. 


An  Institute’s  success  rate  depends  on  its  available  funds,  average  cost  of  recommended  apphcations,  as  weU  as  its  apphcations’  percentile 
scores.  Note  that  these  figures  reflect  DRG-reviewed  apphcations  only. 


Mean  Scores* 

1992  Means 

Success 

Rate** 

1983 

1988 

1992 

New 

Competing 

continuation 

1983 

1992 

NCNR. . 

. . . - 

- 

269 

272 

256 

- 

16.1 

NIA. . . 

. . . 258 

274 

258 

266 

223 

19.9 

27.6 

NIEHS. 

. . . 253 

234 

247 

260 

215 

33.8 

26.2 

NEI. . . 

. . .235 

236 

246 

261 

231 

41.2 

30.9 

NIDDK. 

. . .233 

229 

237 

252 

215 

35.2 

24 . 4 

NICHD. 

. . . 249 

242 

234 

249 

208 

27.3 

25.5 

NHLBI . 

. . . 245 

235 

233 

244 

211 

29.8 

23.1 

NCI. . . 

. . .241 

230 

232 

245 

201 

27.8 

27 . 9 

NIDCD. 

. . .229 

221 

232 

245 

199 

32.9 

29.3 

NINDS. 

. . .235 

228 

232 

248 

208 

29.1 

26.0 

NCHGR. 

. . . - 

- 

225 

236 

191 

- 

21.2 

NIDR. . 

. . .241 

239 

222 

231 

207 

38.1 

26.7 

NIAMS. 

. . .242 

225 

221 

232 

192 

35.3 

19.6 

NIGMS . 

. . .218 

212 

217 

235 

189 

38.3 

34 . 3 

NIAID. 

. . .224 

214 

214 

225 

194 

34 . 2 

24.0 

Minimum. . 218 

212 

214 

225 

189 

19.9 

16.1 

Maximum. . 258 

274 

269 

272 

256 

41.2 

34.3 

*By  fiscal  year  of  IRG  review. 

**By  fiscal  year  of  funds  or  requested  start  date  from  award  rate  file. 
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4.  PRINCIPAL  INVESTIGATOR  CHARACTERISTICS  RELATED  TO  STUDY  SECTION  ACTION 


Degree  of  applicant 

Number  of  applications 

New  and  competing  continuation  applications 
Study  section  actions:  Score  distributions 
Mean  priority  score  trends 
Age  of  applicant 

Distribution  of  applications  (total) 

Distribution  of  applications  (new,  competing  continuations) 
Difference  in  mean  priority  scores 
Gender  of  applicant 

Distribution  of  applications  (new,  competing  continuations) 
Difference  in  age 

Study  section  actions:  Score  distributions 
Mean  priority  score  trends 
Race/ethnic  origin  of  applicant 

Frequency  distributions  of  minority  applicants 
Study  section  actions:  Score  distributions 
Difference  in  mean  priority  scores 


Number  of  DRG-Reviewed  Competing  R01  Applications* 

by  Degree**  of  Applicant 

(number  in  thousands) 

^ FY1992  B FY1988  m FY1983 


Amendments  included 


M.D. 


Ph.D. 


11.9 


*Summarized  by  fiscal  year  of  initial  review.  **M.D.  includes  MD,  MB,  BM,  BMD,  FRCP,  and  joint  MD/PhD  degrees. 

Ph.D.  includes  PhD,  EdD,  DSc,  ScD,  DEng,  DPh,  DPhI,  DPhil,  DPE,  DSN,  DNS,  DSW,  DED,  and  PsyD.  Other  or  unknown 
degrees  are  not  shown. 

Source:  NIH,  DRG,  ISB,  SAES 


7/1 1/94 
W32cg3 


4.  Princ^al  Investigator  Characteristics  Related  to  Study  Section  Action 


During  the  past  10  years,  applicants  with  a Ph.D.  or  another  research  degree  have  both:  (a)  submitted  substantially  more  ROl  applica- 
tions and  (b)  shown  more  growth  in  number  than  appUcants  with  an  M.D.  or  another  clinical  doctorate.  In  1983  appHcations  from  Ph.D.’s 
outnumbered  those  from  M.D.’s  by  2.6  to  1;  by  1992  this  ratio  was  nearly  3 to  1.  The  quantity  of  M.D.  applications  remained  roughly 
constant  between  1983  and  1985,  dropped  sharply  for  the  next  two  years,  and  eventually  returned  to  a one  percent  decline  in  1992.  At 
the  same  time,  the  number  of  applications  from  Ph.D.’s  grew  by  1,319,  or  12.5  percent.  Both  groups  showed  year-to-year  fluctuations 
within  these  trends. 

The  number  of  initial  applications  (excluding  amendments)  from  M.D.’s  has  declined  by  443  — from  3,138  in  1983  to  2,695  in  1992. 
Initial  appHcations  from  Ph.D.’s  decreased  by  178,  from  8,1 18  to  7,940  during  the  same  time  period.  The  percentage  of  initial  appHcations 
declined  by  about  10  percentage  points  for  both  groups,  suggesting  an  increasing  reHance  on  amended  appHcations. 


Amendments 


M.D.* 

Ph.D. 

Other 

M.D.  * 

Ph.D. 

Other 

1983 

4,030 

10,550 

351 

3 , 138 

8,118 

291 

1984 

4,103 

11,144 

374 

3,180 

8,537 

316 

1985 

4,134 

11,898 

386 

3 , 189 

8,933 

291 

1986 

3,810 

11,176 

283 

2 , 842 

8,269 

207 

1987 

3,384 

10,120 

224 

2 , 517 

7,210 

179 

1988 

3,478 

10,198 

205 

2 , 549 

7 , 501 

166 

1989 

4,095 

11,564 

212 

2,877 

7,968 

143 

1990 

4 , 123 

11,660 

192 

2,672 

7,728 

144 

1991 

3,746 

10,950 

154 

2,446 

6,985 

99 

1992 

3.991 

11.869 

130 

2 . 695 

7.940 

92 

1983-92 

-39 

-1-1,319 

-221 

-443 

-178 

-199 

Percent. . . . 

-1.0 

-t-12.5 

-63 . 0 

-14.1 

-2.2 

-68.4 

*For  degree  definition,  see  Technical  Note  No.  7. 

Summarized  by  fiscal  year  of  IRG  review. 

The  above  data  show  a convergence  in  the  proportion  of  amended  appHcations  submitted  by  M.D.  and  Ph.D.  appHcants.  Amendments 
make  up  the  foUowing  percentages  of  reviewed  ROl  appHcations: 


M.D. 

Ph.D. 

Other 

Total 

1983. . . 

...22.1% 

23.1% 

17.1% 

22.7% 

1986. . . 

. . .25.4 

26.0 

26.9 

25.9 

1989. . . 

. . .29.7 

31.1 

32.5 

30.8 

1992 . . . 

. . .32.5 

33.1 

29.2 

32.9 
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DRG-Reviewed  Competing  R01  Applications* 
by  Degree**  of  Applicant  and  Type  of  Application,  FY1 983-1 992  t 

m Ph.D.  m M.D. 


‘Summarized  by  fiscal  year  of  initial  review.  “M.D.  includes  MD,  MB,  BM,  BMD,  FRCP,  and  joint  MD/PhD  degrees. 

Ph.D.  includes  PhD,  EdD,  DSc,  ScD,  DEng,  DPh,  DPhI,  DPhil,  DPE,  DSN,  DNS,  DSW,  DED,  and  PsyD.  Other  or  unknown 
degrees  are  not  shown.  tSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 


7/1 1/94 
W33cg3 


4.  Piinc^al  Investigator  Characteristics  Related  to  Study  Section  Action 


The  proportion  of  applicants  with  an  M.D.  or  another  clinical  doctorate  declined  on  both  new  and  competing  continuation  ROl  applica- 
tions from  1983  to  1987,  and  thereafter  remained  relatively  constant.  New  appHcations  from  M.D.’s  dropped  from  27.7  percent  in  1983 
to  25.5  percent  in  1992.  The  proportion  of  competing  continuation  from  M.D.’s  is  down  3.0  percentage  points,  from  27.5  to  24.5  percent. 


New  Competing 

Applications  Continuations 


Number 

% M.D.* 

Number 

% M.D.* 

1983. . . 

. . .10,257 

27.7 

4,323 

27.5 

1985. . . 

. . . 11,419 

26.1 

4,613 

24.9 

1987. . . 

...  8,491 

25.5 

5,013 

24.4 

1989. . . 

. . . 10,583 

26.6 

5,076 

25.1 

1991. . . 

...  9,563 

26.2 

5,133 

24.3 

1992. . . 

. . . 10,704 

25.5 

5,156 

24.5 

1983-92 . . . 

. . . -1-447 

-2 . 2 

-1-833 

-3 . 0 

In  1992,  M.D.  apphcants  submitted  111  fewer  new  appHcations  and  72  more  competing  continuations  than  in  1983.  By  contrast,  Ph.D.’s 
and  other  research  doctorates  submitted  558  more  new  appHcations  and  761  more  competing  continuations.  With  amendments  excluded 
(table  below),  both  new  and  competing  continuation  appHcations  from  M.D.’s  are  fewer.  The  number  of  nonamended  new  appHcations 
declined  from  1983  through  1992,  but  competing  continuations  increased. 


Excluding  Amendments 


New 

Competing 

Continuations 

New 

Competing 

Continuations 

M.D. 

Ph.D. 

M.D. 

Ph.D. 

M.D. 

Ph.D. 

M.D. 

Ph.D. 

1983 

2,840 

7,417 

1,190 

3,133 

2,269 

5,887 

869 

2,231 

1988 

2,276 

6,531 

1,202 

3 , 667 

1,731 

5,002 

818 

2,499 

1992 

2,729 

7,975 

1,262 

3,894 

1,941 

5,607 

754 

2,333 

1983-92 

-111 

-1-558 

-t-72 

-1-761 

-328 

-280 

-115 

-1-102 

*For  degree  definition,  see  Technical  Note  7.  Summarized  by  fiscal  year  of  IRG  review. 


Note:  Interest  in  other  grant  mechanisms  for  medical  scientists,  however,  have  increased.  These  include  the  Clinical  Investigator  Award 
(K08)  and  Physician  Scientist  Award  (Kll,  K12)  — activities  which  are  generaUy  reviewed  by  Institute  review  panels  (cf.  pp.  4-7). 
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Score  Distribution  for  DRG-Reviewed  Competing  R01  Applications* 

by  Degree**  of  Applicant,  FY1 983-1 992t 


m 100-175  11  176-200  ESI  201-500  □ Dis.  / NRFC 


Percent 


M.  D. 


Percent 


Ph.  D. 


1983 

■85 

■87 

■89 

■91 

■92 

1983 

■85 

■87 

■89 

■91 

■92 

Number:  4,030 

4,134 

3,384 

4,095 

3,746 

3,991 

10,550 

11,898 

10,120 

1 1 ,564 

10,950 

11,889 

Mean:  274 

255 

234 

253 

237 

262 

261 

244 

228 

250 

235 

257 

‘Summarized  by  fiscal  year  of  initial  review.  includes  MD,  MB,  BM,  BMD,  FRCP,  and  joint  MD/PhD  degrees. 

Ph.D.  includes  PhD,  EdD,  DSc,  ScD,  DEng,  DPh,  DPhI,  DPhil,  DPE,  DSN,  DNS,  DSW,  DED,  and  PsyD.  Other  or  unknown 
degrees  are  not  shown.  tSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 
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4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


Until  the  October  1988  Councils,  an  increasing  proportion  of  reviewed  applications  from  both  M.D.  (and  other  clinical  doctorates)  as  well 
as  Ph.D.  (and  other  research  doctorates)  received  scores  in  the  100-150  range.  As  a result  of  the  use  of  percentile  ranking  as  an  indicator 
of  application  quahty  and  the  use  of  common  descriptive  adjectives,  however,  applications  reviewed  for  the  October  Council  (and  thereaf- 
ter) showed  a sharp  decline  in  scores  in  this  range.  Thus,  the  overall  1988  percentage  in  this  score  range  dropped  for  the  first  time  in 
10  years.  This  percentage  continued  to  drop  through  1989,  increasing  in  1990  and  1991  and  declined  again  in  1992. 

M.D.  applicants  have  a sHghtly  higher  rate  of  disapproval/NRFC  and  a sHghtly  lower  percentage  of  scores  in  the  100-175  range  than  Ph.D. 
appHcants.  Differences  between  M.D.  and  Ph.D.  rates  range  from  1 to  3 percentage  points  each  year. 

Disapproval  of  apphcations  from  M.D.’s  declined  by  10.9  percentage  points  — from  13.4  percent  in  1983  to  2.5  percent  in  1991.  The 
NRFC  classification  substantially  lowered  the  proportion  of  rated  M.D.  apphcations  in  1992.  Ph.D.  apphcants,  with  a sHghtly  lower  initial 
disapproval  rate  (10.2  percent),  also  saw  a decline  in  disapprovals  (8.1  percentage  points,  through  1991).  The  NRFC  classification  also 
substantiaUy  lowered  the  proportion  of  rated  Ph.D.  apphcations  in  1992. 


Percentage  Disapproved/NRFC  Percentage  100-150  Percentage  100-175 


M.D. 

Ph.D. 

M.D. 

Ph.D. 

M.D. 

Ph.D 

1983. . . 

. .13.4 

10.2 

11.4 

13.4 

25.6 

28.9 

1984. . . 

..12.0 

9.4 

12 . 8 

14 . 3 

28.4 

31.0 

1985. . . 

. . 9.1 

6.8 

17.4 

19.4 

30.8 

34.2 

1986. . . 

. . 6.5 

5.0 

22.0 

22.3 

35.5 

38.6 

1987.  . . 

. . 5.3 

4.4 

23.7 

24.6 

37.1 

39.9 

1988.  . . 

. . 3.7 

3.5 

20.2 

20.1 

33.2 

34.1 

1989. . . 

. . 2.7 

2.2 

12.5 

11.4 

25.2 

25.8 

1990. . . 

. . 1.9 

1.8 

16.1 

15.5 

28.9 

29.5 

1991. . . 

. . 2.5 

2.1 

19.0 

17 .1 

31.3 

32.3 

1992. . . 

..11.0 

10.3 

14.1 

14.6 

25.7 

27.8 

1983-91. . . 

.-10.9 

-8.1 

-1-7.6 

-1-4.3 

-H5.7 

-H3 .4 

1983-92. . . 

. -2.4 

-1-0.7 

+2.1 

-HI.  2 

-HO.l 

-1.1 
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Mean  Priority  Scores  of  DRG-Reviewed  Competing  R01  Applications* 

by  Degree**  of  Applicant,  FY1 976-1 992 


Mean  Score 


M.D.  Illllllllllllll  PhD. 


'Summarized  by  fiscal  year  of  initial  review.  Excludes  withdrawals  and  supplements.  Includes  original  and  amended  applications. 
"M.D.  includes  MD,  MB,  BM,  BMD,  FRCP,  and  joint  MD/PhD  degrees.  Ph.D.  includes  PhD,  EdD,  DSc,  ScD,  DEng,  DPh,  DPhI,  DPhil, 
DPE,  DSN,  DNS,  DSW,  DED,  and  PsyD.  Other  or  unknown  degrees  are  not  shown. 

Source:  NIH,  DRG,  ISB,  SAES 


6/28/94 

W35cg3 
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4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


In  general,  Ph.D.’s  averaged  slightly  better  scores  than  M.D.’s  (including  M.D./Ph.D.)  on  both  new  and  competing  continuation  ROl 
appUcations  through  1987.  Subsequently,  mean  score  differences  have  become  3 points  or  less;  as  such,  their  performances  are  approxi- 
mately equivalent. 

New  Applications  Competing  continuations 
M.D.  Ph.D.  M.D. Ph.D. 


1983  . . . 

. . .253 

247 

211 

206 

1985. . . 

. . .244 

240 

200 

191 

1987.  . . 

. . .237 

234 

189 

186 

1989.  . . 

. . .262 

262 

211 

211 

1991. . . 

. . .245 

246 

201 

201 

1992.  . . 

. . .246 

243 

207 

204 

Regardless  of  the  appHcanfs  degree,  appHcations  from  basic  science  departments  average  better  scores  than  those  from  cUnical  or  other 
departments.  (See  Technical  Note  16,  pagex/i  regarding  the  present  definitions  of  "basic"  and  "clinical"  science.) 


Number  Reviewed  Mean  Priority  Scores 


M.D.*  Ph.D.  M.D.  Ph.D. 

1983 721  5,656  251  243 

Basic  1985 719  6,338  237  229 

Science  1987 562  5,302  221  215 

1989 676  5,877  237  241 

1991  645  5,468  226  225 

1992  637 5 . 839 253 246 


1983 2,274  1,606  281  277 

Clinical  1985 2,382  1,899  254  251 

Science  1987 1,927  1,628  235  231 

1989 2,262  1,794  255  252 

1991  2,082  1,907  238  241 

1992  2.198 2 . 117 263 264 


1983 117  1,663  292  304 

Other  1985 95  1,791  294  284 

Departments  1987 105  1,663  262  264 

1989 128  1,961  268  271 

1991  141  1,736  251  258 

1992  125  1,791  274  278 


From  institutions  of  higher  education;  summarized  by  fiscal  year  of  IRG  review. 
*M.D.  includes  joint  M.D./Ph.D. 
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Age*  Distribution  of  Principal  Investigators  for  DRG-Reviewed 
Competing  R01,  R23,  and  R29  Applications,**  FY1 983-1 992 


Percent 


1983  '84  '85  '86  '87  '88  '89  '90  '91  '92 


*Age  computed  as  of  October  of  specified  year. 

**Competing  applications  summarized  by  requested  start  date  or  fiscal  year  of  funds. 
Source:  NIH,  DRG,  ISB,  SAES 
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4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


To  encourage  those  beginning  (typically  younger)  investigators  in  their  pursuit  of  NIH  funding,  two  mechanisms  (the  R23  and,  subse- 
quently, the  R29)  were  developed.  To  better  Ulustrate  age  trends  in  demographic  strata,  R23’s,  R29’s,  and  ROl’s  were  chosen  for  these 
analyses. 

Despite  such  an  inclusion  of  typically  younger  investigators,  however,  the  major  change  in  the  age  of  these  appHcants  has  been  a steady 
annual  erosion  in  the  proportion  who  are  35  years  of  age  or  younger.  This  proportion  has  declined  from  21.3  percent  of  appUcations 
in  1983  to  only  12.2  percent  in  1992.  This  includes  an  annual  decline  in  the  small  group  of  appUcations  from  those  who  are  26  to  30 
(2.8  percent  in  1983  to  1.1  in  1992).  While  the  advent  of  FIRST  (R29)  awards  in  1987  may  have  interrupted  this  trend  briefly,  the 
young-researcher  segment  of  appUcants  now  has  sUpped  to  its  lowest  point  in  a decade. 

There  is  a sUght  increase  m appUcants  36  to  45  years  of  age,  while  the  proportion  over  45  has  grown  even  more  - from  31.4  percent 
in  1983  to  39.5  percent  in  1992.  This  gradual  shift  in  age  distribution  is  also  reflected  in  a 1.8  year  increase  in  the  average  age  of 
appUcants  since  1983  (from  42.7  to  44.5). 


Percentage  of  Applications 


Year 

Number 

Number  with  Age 

35  or  Less 

36  - 40 

41  - 45 

46  - 50 

50  and  Older 

Average  Age 

1983 

15,065 

12,926 

21.3 

27.4 

19.8 

12.4 

19.0 

42.7 

1984 

15,009 

14,290 

20.3 

27.4 

20.7 

12.7 

18.9 

42.8 

1985 

16,432 

15,951 

18.3 

26.2 

22.3 

13.5 

19.6 

43.2 

1986 

15,699 

15,273 

18.2 

26.5 

22.4 

13.7 

19.2 

43.1 

1987 

15,511 

15,057 

20.0 

26.3 

21.9 

13.5 

18.4 

42.9 

1988 

16,063 

15,709 

19.5 

26.3 

21.9 

14.2 

18.1 

43.0 

1989 

16,828 

16,429 

16.9 

25.8 

22.9 

15.2 

19.1 

43.5 

1990 

17,807 

15,516 

15.5 

25.5 

21.9 

16.8 

20.4 

43.8 

1991 

16,674 

16,124 

13.2 

25.6 

23.2 

17.2 

20.8 

44,2 

1992 

17,261 

17,037 

12.2 

25.2 

23.1 

17.5 

22.0 

44.5 

1983-92 

-1-2,196 

-1-4,111 

-9.1 

-2.2 

-1-3.3 

-1-5.1 

-1-3.0 

H-1,8 

A similar  age  trend  is  found  in  both  new  and  competing  continuation  appUcants,  and  in  men’s  and  women’s  appUcations. 

It  should  also  be  noted  that  the  age  of  principal  investigators  submitting  these  appUcations  has  been  recorded  in  the  IMPAC  data  system 
since  1979.  During  this  period,  nonresponse  to  this  item  has  ranged  from  2 to  6 percent  excepting  1983  (14  percent  due  to  a data  pro- 
cessing error)  and  1990  (13  percent). 
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Age*  Distribution  of  Principal  Investigators  for  DRG-Reviewed  Competing 
R01,  R23,  and  R29  Applications**  by  Type  of  Application,  FY1983-1992t 


35  or  less 


36  - 40 


41-45  E21  46  ■ 50 


□ over  50 


-1  o fi  ,V,  4 i o 

lO.y  .V.  11.0 

: 


7777777i  

/XXX/XXXXXXX/XXXXXXXX/XXrf 

/X////X/XXXX///X/XXXX/X/rf 

//XXXXXXXXXXX/XXXXXX/XXXrf 

XXXX/XXXXXXXX/XXXX/XXXXXrf 

//XXXXXXXXXXXX/XXX/XXXXXrf 


X/XXXXXX/XXXXXX/XXXX/,f 

X/XXXXXXXXXX/XXXXXXXXrf 

✓/XXX/X//‘XXX/X//XXXX/rf 

XXXXX//X/XXXX///XXX/Xrf 

XXXXX/XXXXXX/XXXXXXXXrf 

XXXXXXX/XXXXXXXXXXXXXrf 


xxxxxxxxxxxxxxxxxxxxxxxx 

/✓xxxxxxxxxxxxxxxxxxxxxx 

XXXX//X/XXX/XXXXXX/XXXXX 

XX/XX/XXXXX//X/XXX/XX/XX 

xxxx/xxxx/xxxxxxxxxx/xxx 

xxxxxxxxxxxxxxxxxxxx/xxx 


VXXXX/XXXXXXXXXXXXXXX/Xw 

'XXXXX/XXXXXX/XXXXXXXXXX. 

'XXXXXXXXXXXX/XXXXXXXXXX. 

*xxxxx/xxxxxx/xxxxx/xxxx. 

"XXXXX/XXX//XXXXXXXXXX/X.( 

V/X/XX/X/XXX//X/XXXXX/X- 


x/x/xxxx#  xxxxxxxxx 
XX//XXXX#  rtrt  /\  xxxxxxxxx 
✓XXX/XXX#  XX  n xxxxxxxxx 
✓XX/XXXXrf  ■ xxxxxxxxx 
XXXXXXXXrf  xxxxxxxxx 
/xx/x/x/xxxxxxxxxx/xxxxxx 


17.0 


15.3 


“T" 

75 


18.5 


/XXX//XXX.  xxxxxx/x 
X/XX///XX.  ^ xxx/x/xx 
XXXX/X/XX.  PP  O xxxxxxxx 
xxxxyyxxx. 


XXX/XXXXXXXXXXXXXXXXXXXX/XXrf 


xxxxxxxxx/x/xxxxxxxxxxx/x/x. 

xxxxx/xxxx/xxxxxxxxx/x/xxxx. 

XXXXX/X/XX//XXXXX/XXXXXX/XX. 

xxxxxxxx/xx/x/xxx/xx/x/xxxx, 


Competing 

Continuations 


'XX/XXXXX/XX/X/X/XXXXXX/XXXXXXX/ 

’XXXXXXXXX/XXX////XXX/X/XXXXXXX/ 

vxxxxx/xx/x/x//xxxxxxxxxx/x/xx> 


..:  V/XXXX//X/X/XXX///XX//X/X/X/XX/ 
$::  VXXXXXXXXXXXXXX/X/X//XXXX/X//X/ 


//XXXXXXX/XXXXXXXX///XX/XXXXXX/ 

V//XXXXXXXXXXXX/XX/XXXXX/XXXXX/ 

'/XXXXXXX/XX//X///XX/XXXXXXXXXX/ 


:l/xxxxxxxxx/ 

J/XXX/XXXXXy 

:lxxxxxx/x/xrf 

:lxxxxx/xxx//^ 


T 

25 


xxxxxxxxxxx 

XXX/////XXX 

rXX/XXXX/XXX 


x:  13.9 


24.1 


'll  / ^xxx>».^>./»»»»»»ji 

M 

vxx/xxxx/xxxxxxxxxxxxxxxxx/x/xx. 
1QQ1  ' vxxxxxxxxxxxxxxxxxxxx/xxx/xxxxx. 

• VXXXXXXXXXXXXXXX/X/XXXX/X//XXXX. 

i66»a  ^ ' vxxxxx/x/xxxx/xxxxxxxxxxxxxxxxx. 

'X  'XXXXXXXXXXXXXXXXXXXXXXXXXXXXX. 

1“ 

50 


22.7 


29.8 


“T" 

75 
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*Age  computed  as  of  October  of  given  year. 

**Competing  applications  summarized  by  requested  start  date  or  fiscal  year  of  funds.  tSelected  years. 
Source:  NIH,  DRG,  ISB,  SAES 


Average  Age 

42.0 

42.5 
41.8 

42.6 

43.0 
43.3 


100% 


100% 


44.5 

44.8 

45.1 

45.5 

46.8 

47.2 
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4.  Principal  Investigator  Qiaracteristics  Related  to  Study  Section  Action 


New  and  competing  continuation  ROl,  R23,  and  R29  applications,  both  initial  and  amended,  all  confirm  the  decline  in  the  proportion 
of  apphcations  from  investigators  35  years  or  younger.  In  new  apphcations,  this  proportion  has  declined  8.6  percentage  points  since  1983 
- from  24.9  to  16.3  percent  in  1992;  in  competing  continuations,  9.2  points,  from  12.1  percent  in  1983  to  2.9  in  1992.  Amendments 
show  a lower  but  also  declining  percentage  of  apphcations  from  the  35-or-under  age  group.  Both  new  and  competing  continuation  apph- 
cations showed  steady  declines  in  the  26-to-30  age  group  - 3.8  to  1.5  percent  for  new  apphcations  and  0.5  to  0.1  percent  for  competing 
continuations.  In  FY  1992,  apphcants  between  26  and  30  years  of  age  submitted  only  82  new  ROl  apphcations  — a significant  decline 
from  the  328  submitted  in  1983, 

Percentages  of  ROl,  R23,  and  R29  apphcations  from  the  35-or-under  age  group  are  as  foUows: 


New  Applications  Competing  continuations 


Total 

Non- 

Amend. 

Amend. 

Total 

Non- 

Amend. 

Amend. 

1983. 

. . .24.9 

25.7 

21.9 

12.1 

13.2 

9.5 

1985. 

. . .21.9 

22.7 

19.1 

9.7 

10.2 

8.3 

1987. 

...25.9 

28.5 

17.6 

8.4 

9.7 

5.6 

1989  . 

...21.0 

21.6 

19.3 

7 . 2 

8 . 4 

5.1 

1991. 

. . .17.9 

18.9 

15.6 

3 . 0 

3 . 0 

3 . 0 

1992  . 

...16.3 

17 . 2 

14 . 3 

2 . 9 

3.4 

2.2 

1983-92 . 

..  -8.6 

in 

00 

-7.6 

-9.2 

-9.8 

-7.3 

As  the  number  of  younger  ROl  apphcants  declined,  apphcations  for  New  Investigator  Research  Awards  (R23)  and  FIRST  Awards  (R29) 
increased.  Although  some  of  the  decline  in  younger  ROl  apphcants  may  be  attributed  to  shifts  to  the  R29  program,  the  number  of  young- 
er research  apphcants  stih  continues  to  decline. 


1983  1985  1987 

ROl  (New) 

26-30  yrs 328  307  166 

31-35  yrs 1,851  2,041  1,250 


R23/R29  1,006  1,171  2,680 


1989 

1991 

1992 

Difference 

1983-1992 

98 

73 

82 

-246 

1,261 

1,031 

1,014 

-837 

1,759 

1,749 

1,742 

-1-736 
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Mean  Priority  Scores  of  DRG-Reviewed  New  R01  Applications* 
by  Age  of  Principal  Investigator,  FY1983  and  FY1992 


m FY1983  m FY1992 


Age 

over  50 


46-50 


41-45 


36-40 


35  or  less 


Mean  Priority  Score 


Applications 

1,324 

1,107 

1,198 

829 

1,676 

1,378 

1,841 

2,673 

805 

1,903 
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*DRG  approved/rated  applications  summarized  by  requested  start  date  or  fiscal  year  of  funds; 
excludes  withdrawals  and  supplements. 

Source;  NIH,  DRG,  ISB,  SAES 


6/15/94 

W38cg3 
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4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


Ironically,  it  is  the  shrinking  26-to-35  age  group  that  receives  the  best  scores  and  is  the  most  successful  in  obtaining  NIH  funding.  This 
age  group  primarily  submits  new  applications;  few  applicants  for  competing  continuations  are  in  the  26-to-30  age  group.  These  lower 
scores  translate  into  substantially  higher  success  rates  for  younger  principal  investigators’  new  applications.  For  new  applications,  FY 
1992  rates  range  from  a high  of  31.7  percent  in  the  26-to-30  age  group  to  only  12.0  for  apphcants  in  the  66-to-78  age  group.  In  the 
case  of  competing  continuations,  however,  applicants  aged  36  to  50  average  better  scores  than  applicants  50  years  or  over. 

With  the  exception  of  those  investigators  in  the  6l-to-65  age  group,  competing  continuation  apphcants  over  55  clearly  have  declining 
success  rates.  Despite  nearly  uniform  improvement  in  mean  priority  scores,  there  has  been  a general  decline  in  success  rates  for  aU  age 
groups  over  the  decade. 


Mean  Scores 


Success  Rates* 


New 


Competing 

Continuation 


New 


Competing 

Continuation 


Aae 

1983 

1992 

1983 

1992 

1983 

1992 

1983 

1992 

26-30. . 

. . .228 

209 

■k  k 

k k 

35.3 

31.7 

k k 

* * 

31-35. . 

. . .237 

212 

201 

lie 

30.1 

27.5 

51.7 

50.4 

36-40. . 

. . .247 

220 

207 

190 

25.7 

22.9 

46.3 

43.8 

41-45. . 

. . .258 

226 

207 

187 

21.2 

19.9 

48.4 

43.9 

46-50. . 

. . .261 

231 

209 

191 

20.7 

18.3 

51.0 

41.3 

51-55. . 

. . .261 

238 

211 

194 

19.9 

15.9 

45.5 

40.5 

56-60. . 

. . .262 

245 

212 

204 

15.4 

15.9 

49 . 0 

33.9 

61-65. . 

. . .278 

254 

214 

200 

12.7 

13.1 

45.4 

39.0 

66-78. . 

. . .254 

262 

217 

197 

29.0 

12.0 

48 . 4 

32.5 

By  fiscal  year  of  funds  or  requested  start  date. 


*See  Technical  Note  13,  page  xii. 
**Fewer  than  50  apphcations  rated. 


These  data  strongly  suggest  that  priority  scores  and  success  rates  for  new  apphcations  vary  according  to  the  age  of  the  investigator;  in 
general,  the  younger  the  investigator  the  better  the  priority  score  and  success  rate. 
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Percentage  of  DRG-Reviewed  Competing  R01  Applications* 
by  Type  and  Applicant  Gender,  FY1 983-1 992t 

B Men  B Women 


Percent 
100^ 


75-- 


50-- 


25-- 


15.6 


84.4 


New  Applications 


^ ❖•'A  S 


W0^ 


4^ 


A A 

'i 

r?i 

•• 

. K'! 


M in  ih 


'' 


\ 


IM 

H 

''  'i 


19.6 


■ 

80.4 


w 


Percent 


Competing  Continuations 


100 


75 


50-- 


25 


12.6 

'wV^ViiW'i 


87.4 


S / 


Mil 


k3 ka 


w 


iPi 

M 


■ 


•'  ^ 

- 

■ 

.•s'  ^ 

s ? \ 

/J's 

7f '-' 

' f Vi 


i® 


16.7  I 

iaiis'' 


83.3 


w 


1983 

in 

00 

■87 

o> 

00 

■91 

■92 

1983 

00 

CJl 

■87 

00 

(O 

■91 

■92 

7,950 

9,869 

7,301 

9,509 

9,090 

9,460 

2,941 

3,904 

4,294 

4,647 

4,890 

4,506 
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*Excludes  withdrawals  and  supplements,  and  those  applications  where  gender  was  not  reported.  Includes  original  and  amended 
applications  summarized  by  fiscal  year  of  initial  review. 
iSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 
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4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


ROl  competing  applications  reviewed  by  DRG  study  sections  have  shown  a steady  annual  increase  in  the  proportion  of  women  applicants, 
from  14.8  percent  of  1983  applications  to  18.7  percent  in  1992.  Growth  was  relatively  even  throughout  the  decade,  with  an  increase 
of  2.7  percentage  points  from  1983  to  1988,  and  1.2  percentage  points  from  1988  to  1992.  Increases  in  the  proportion  of  appHcations 
from  women  appeared  in  both  new  and  competing  continuation  appHcations,  but  with  the  expected  3-  to  4-year  lag  among  competing 
continuations.  The  percentage  of  female  appHcants  for  competing  continuations  peaked  in  1988  (17.4  percent),  and  then  declined  to 
16.7  in  1992. 


Competing 

Total New Continuations 


Year 

Number* 

%W 

Number* 

%W 

Number* 

%W 

1983 . . . 

. . . 10,891 

14.8 

7,950 

15.6 

2,941 

12.6 

1984. . . 

, . .13,344 

15.7 

9,379 

16.8 

3,965 

13 . 0 

1985. . . 

. . . 13,764 

15.8 

9,860 

16.5 

3,904 

14.3 

1986. . . 

. . .12,825 

16.0 

8,462 

16.6 

4,363 

15.0 

1987.  . . 

. . . 11,595 

17.2 

7,301 

17 . 9 

4,294 

16.0 

1988  . . . 

. . . 12 , 127 

17.5 

7,724 

17.6 

4,406 

17.4 

1989  . . . 

. . . 14 , 156 

18.3 

9,509 

19.2 

4,647 

16.4 

1990. . . 

. . . 13 , 290 

18 . 2 

9,132 

19 . 2 

4 , 158 

16.1 

1991. . . 

. . .13,980 

18.3 

9,090 

19 . 6 

4 , 890 

15.7 

1992.  . . 

. . . 13 , 966 

18 . 7 

9,460 

19 . 6 

4 , 506 

16.7 

* 


Number  with  gender  reported;  summarized  by  fiscal  year  of  IRG  review. 


Amendments  as  a percentage  of  reviewed  ROl  appHcations  were  as  foUows; 


Competing 


New 

Continuations 

Men  Women 

Men  Women 

1983 . . . 

. . .20.2 

18.8 

27.5 

29.6 

1985. . . 

. . .23.2 

23.4 

24.8 

28.1 

1987. . . 

...25.1 

25.9 

29.8 

31.5 

1989. . . 

. . .27.6 

30.0 

34.4 

35.6 

1991. . . 

...33.1 

34.2 

41.6 

39.0 

1992. . . 

. . .28.7 

29.9 

39.7 

40.3 

75 


I 

Age  and  Gender  Distribution  of  Principal  Investigators  for 
DRG-Reviewed  Competing  R01  Applications,*  FY1 983-1 992t 


Men 


35  or  less 


36-40 


41  -45 


46-50  □ over  50 


1983 

1985 

1987 

1989 

1991 

1992 


Average  Age 
43.0 
43.4 

44.2 

44.6 

45.2 

45.7 


Women 


1983 
1985 
1987 
1989 

1991 

1992 

0 25  50  75  100% 


41.3 

41.8 

42.3 

42.9 
43.6 

44.0 
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‘Competing  applications  summarized  by  requested  start  date  or  fiscal  year  of  funds.  Excludes  applications 
with  age  and/or  sex  unknown.  tSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 
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4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


The  decline  in  the  proportion  of  ROl  apphcations  submitted  by  younger  investigators  (35  years  or  less)  appears  in  both  sexes.  Among 
men,  the  proportion  declined  by  12.4  percentage  points,  from  20.6  percent  in  1983  to  8.2  percent  in  1992.  Apphcations  from  younger 
women  showed  a higher  but  also  more  rapidly  declining  proportion  (16.6  percentage  points),  from  25.9  percent  in  1983  to  9.3  percent 
in  1992. 


Men Women 


% 35 

% 35 

Year  Number* 

or  less 

Number* 

or  less 

1983...  9,550 

20.6 

1,691 

25.9 

1984. . .10,615 

18.9 

1,930 

26.9 

1985. . .11,506 

17.6 

2,085 

23.0 

1986. . .10,974 

17.8 

2,142 

21.8 

1987...  9,563 

14.2 

1,934 

17.1 

1988...  9,938 

13 . 0 

2,059 

17.5 

1989 . . . 10,941 

12 . 3 

2,375 

16.4 

1990. . .11,111 

11.1 

2 , 496 

13 . 3 

1991. . .11,518 

8.9 

2 , 520 

11.6 

1992. . .11,405 

8 . 2 

2 , 584 

9 . 3 

1983-92. . .+1,855 

-12.4 

+893 

-16.5 

*Apphcations  with  both  age  and  gender  recorded. 


The  proportion  of  apphcations  submitted  by  the  41  to  45  age  group  grew  for  both  sexes.  From  1983  to  1992,  the  average  age  of  an  apph- 
cant  increased  by  nearly  three  years  for  both  sexes.  Over  the  decade,  the  decline  in  under-35  apphcants  is  particularly  steep,  regardless 
of  gender:  the  modal  age  group  of  under-40  has  now  shifted  from  36  to  45  years  of  age. 

As  seen  elsewhere  before,  the  pattern  in  mean  priority  scores  by  age  group  indicates  that  young  scientists  get  the  best  scores.  This  general 
decline  in  the  number  of  younger  scientists,  the  "greying  of  research,"  is  a worrisome  trend. 
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DRG  Study  Section  Action  on  Competing  R01  Appiications* 
by  Gender**  of  Appiicant,  FY1 983-1 992t 


100-150  B 151-175  B 176-200  B 201-500  □ Dis/NRFC 


Men 


Women 


9.8 


W.iiiffViiYif 


51.8 


11.5 


xxxxxxxxxxx> 

XXXXXXXXXXX/ 
XXXXXXXXXXX/ 
XXXXXXXXXXX/  ’ 


'XXXXXXXXXXXX. 
: VXXXXXXXXXXX. 
: 'XXXXXXXXXXXX 
'XXXXXXXXXXXX 
'XXXXXXXXXXXX 




'X. XXX 

1 1 .6 

'X.  XXX 


50.4 


10.5 


25 


50 


75 


100 


'XXXXXXX^ 


7.5 


jrX./  • 


53.2 


'XXXXXXXXXX 

'XXXXXXXXXX 

'XXXXXXXXXX 

'XXXXXXXXXX 

'XXXXXXXXXX 

'XXXXXXXXXX, 


13.7 


S!  rrrr 

iW  /XXXXXXXXXXXX/  •. 
/XXXXXXXXXXXX/  *. 
/XXXXXXXXXXXX/ 
/XXXXXXXXXXXX/  *. 


/XXXXXXXXXXXX/  ' 


XXXXXXXXXXX/ 

XXXXXXXXXXX/ 

XXXXXXXXXXX/ 

XXXXXXXXXXX/ 

XXXXXXXXXXX/ 


12.7 


I 


'XXXXXXXXXXXX. 

'XXXXXXXXXXXX. 

'XXXXXXXXXXXX. 

'XXXXXXXXXXXX. 

'XXXXXXXXXXXX. 

'XXXXXXXXXXXX. 


XXXXXXXXXX 

'XX XXX. 

'X#  . . - XXX. 

'X/  1 1 4 XXX 

'X/  XXX, 


51.2 


10.9 


% 


25 


50 


75 


100% 


'Excludes  withdrawals  and  supplements.  Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial 
review.  "Based  on  applications  reporting  gender.  tSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 


Mean 

Score 

237 

227 

217 

254 

229 

230 


241 

235 

223 

246 

233 

231 


Number* 

9,283 

11,587 
9,604 
1 1 ,566 
1 1 ,424 
11,358 

1,608 

2,177 

1,991 

2,590 

2,556 

2,608 

7/12/94 

W41cg3 
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4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


The  proportion  of  ROl  applications  rated  as  well  as  the  proportion  in  the  potentially  fundable  range  followed  much  the  same  pattern  for 
female  and  male  applicants.  From  1983  to  1991,  non-rated  applications  from  women  declined  by  11  points,  from  13.7  to  2.7  percent. 
For  men,  the  percentage  of  non-rated  applications  dropped  by  9.4  percentage  points,  from  11.5  percent  to  2.1  percent.  The  advent  of 
the  NRFC  classification  in  1992,  as  noted  elsewhere,  substantially  reversed  this  trend. 

At  the  same  time,  appHcations  with  the  best  scores  (100-175)  showed  some  variability  over  the  decade,  ranging  from  26.9  (1983)  to  39 
(1987)  percent  for  men,  and  from  25.3  (1989)  to  35.6  (1986)  percent  for  women.  For  most  of  the  decade,  a smaller  proportion  of 
women’s  appHcations  received  scores  of  175  or  better.  The  data  below  suggest  that  this  is  primarily  in  the  area  of  competing  continua- 
tions. The  percentage  of  reviewed  appHcations  with  scores  175  or  better*  foUow: 

Competing 

Total  New  Continuations 


Year 

Men 

Women 

Men 

Women 

Men 

Women 

1983 

26.9 

25.6 

21.1 

21.8 

42.1 

38.3 

1984 

30.5 

26.9 

22 . 6 

20.2 

48.3 

47.4 

1985 

32.8 

30.0 

24 . 9 

24.0 

52.5 

47.6 

1986 

.....37.3 

35.6 

28 . 1 

27.7 

54 . 7 

52.4 

1987 

39.0 

34.2 

28 . 4 

25.2 

56.7 

51.2 

1988 

33.9 

31.3 

24 . 3 

21.5 

50.7 

48.8 

1989 

25.0 

25.3 

18 . 1 

20.9 

38.6 

36.0 

1990 

29.0 

27 . 0 

22 . 1 

22 . 2 

43.5 

39.4 

1991 

32.5 

29.2 

23 . 0 

23 . 6 

45.5 

42 . 4 

1992 

27.5 

26.5 

20.3 

21.3 

42.0 

39.2 

Initial  and  amended  appHcations  summarized  by  fiscal  year  of  IRG  review. 

Female  appHcants  have  a much  lower  percentage  of  M.D.  (or  joint  M.D./Ph.D.)  degrees  ~ 14.2  versus  27.0  percent  for  men  in  1992  — 
and  female  Ph.D.’s  enjoy  a better  success  rate  than  female  M.D.’s. 


Applications  Mean  Scores  Success  Rates 

Men  Women  Men  Women  Men  Women 

M.D.* 27.0  14.2  215  226  26.3  22.7 

Ph.D 72.2  84.7  214  218  27.8  28.1 


Other  or  NA. . . 0.8  1.1 

*Includes  joint  M.D./Ph.D.;  summarized  by  fiscal  year  of  funds  or  requested  start  date  from  award  rate  file. 
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Mean  Priority  Scores  of  DRG-Reviewed  Competing  R01  Applications* 

by  Gender  of  Applicant,  FY1 983-1 992 


Mean  Score 


‘Includes  original  and  ammended  applications  summarized  by  fiscal  year  of  initial  review;  excludes  withdrawals  and  supplements, 
and  applications  where  gender  was  not  reported. 

Source:  NIH,  DRG,  ISB,  SAES 


6/1 5/94 
W42cg3 


4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


Through  the  decade,  women’s  ROl  application  scores  nearly  matched  those  of  men.  (In  later  years,  though,  men’s  competing  continuation 
apphcations  have  fared  somewhat  better.)  Score  differences  ranged  from  1 to  8 points. 


Total 


New Competing  Continuation 


Year  Men 

Women 

Men 

Women 

Men 

Women 

1983 . . .237 

241 

250 

252 

208 

208 

1984. . .232 

237 

248 

250 

200 

202 

1985. . .227 

235 

242 

248 

194 

199 

1986. . .218 

221 

235 

237 

188 

188 

1987. . .217 

223 

237 

240 

186 

192 

1988. . .229 

233 

248 

255 

196 

196 

1989. . .245 

246 

263 

259 

211 

214 

1990. . .237 

241 

253 

253 

204 

211 

1991. . .229 

233 

246 

246 

201 

205 

1992. . .230 

231 

244 

241 

203 

208 

Summarized  by  fiscal  year  of  IRG  review. 


Study  sections  are  grouped  in  review  sections,  primarily  by  subject  matter.  In  1992,  the  largest  portion  of  women’s  ROl  applications  were 
reviewed  by  the  Behavioral/Neurosciences  Review  Section  (23.4  percent),  and  the  Physiological  Sciences  Review  Section  (18.7  percent); 
the  smallest  portion  of  these  applications  were  reviewed  by  the  Biomedical  Sciences  Review  Section  (10.1  percent)  and  the  Immunology, 
Virology,  and  Pathology  Review  Section  (11.9  percent).  The  smallest  portion  of  men’s  apphcations  went  to  the  Immunology,  Virology 
and  Pathology  Review  Section  (11.6  percent),  with  all  other  review  sections  (except  Special  Review  Section)  to  18  percent.  Women  aver- 
aged scores  that  were  equal  to  or  better  than  men’s  on  apphcations  reviewed  by  the  Biomedical  Science  Review  Section  but  worse  than 
men’s  in  ah  others.  The  distribution  of  1992  reviewed  apphcations,  mean  scores,  and  success  rates  are  as  foUows  : 


Percentage  of 


Aoolications 

Mean 

Scores 

Success 

Rates 

Review  Section 

Men 

Women 

Men 

Women 

Men 

Women 

Behav/Neurosciences . . . . 

.17.6 

23.4 

265 

271 

28.0 

27.4 

Biological  Sciences.... 

.16.4 

17.7 

237 

246 

29.6 

28.2 

Physiological  Sciences. 

.17.7 

18.7 

238 

239 

29.0 

29.9 

Clinical  Sciences 

.18.1 

17.8 

257 

263 

24.6 

26.5 

Biomedical  Sciences.... 

.17.5 

10.1 

244 

237 

25.7 

29.9 

Special 

. 1.1 

0.4 

265 

268 

27.3 

23.7 

Immunology /Virology. . . . 

.11.6 

11.9 

241 

296 

38.8 

33.3 

Total 

100.0 

100.0 

253 

258 

27.3 

27.3 

From  success  rate  file  by  fiscal  year  of  funds  or  requested  start  date. 
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Minority  Representation  Among  Principal  Investigators  for 
DRG-Reviewed  Competing  R01  Applications,*  FY1 983-1 992t 


1983 

Number*:  10,209 


1985 

12,287 


1989 

11,861 


1991 

12,509 


Am.Indian/Alaskan  Native 


Asian/Pacific  Islander 


1992 

1 1 ,475 


82 


*Competing  applications  summarized  by  requested  start  date  or  fiscal  year  of  funds  from  success  rate  file. 
Encrypted  data  captured  since  May  1 981 . Number  with  response  shown.  tSelected  years. 

Source:  NIH,  DRG,  ISB,  SAES 
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4.  Piinc^al  Investigator  Characteristics  Related  to  Study  Section  Action 


The  proportion  of  ROl  applications  from  racial/ethnic  minorities  has  grown  very  slowly,  increasing  by  only  2 percentage  points  between 
1983  and  1992,  from  11.7  to  13.7  percent  of  aU  apphcations  with  ethnic  data  provided.  (The  ethnic  terms  used  here  correspond  to  the 
choices  provided  on  PHS  Form  398,  September,  1991  revision  of  "Personal  Data  on  Principal  Investigator/Program  Director".  A further 
discussion  may  be  found  in  the  Glossary,  pp.  122f.) 

The  relative  ordering  of  proportions  of  the  four  kinds  of  minority  groups  also  remains  unchanged.  AppHcants  of  Asian/Pacific  Island  ori- 
gin consistently  submit  more  than  three  times  as  many  apphcations  as  all  other  minority  groups  combined  - 10.6  percent  of  total  ROl 
apphcations  reporting  race  in  1992.  It  should  also  be  noted  that  it  is  largely  the  growth  in  their  group’s  submissions  which  has  fueled 
the  overah  increase.  The  next  largest  group,  apphcants  of  Hispanic  origin,  submitted  1.6  percent  of  ROl  apphcations  in  1983  and  2.1 
percent  in  1992.  The  proportion  submitted  by  Black  apphcants  remains  under  1 percent,  and  shows  httle  variabhity.  American 
Indian/ Alaskan  origin  apphcants  make  up  the  smaUest  group,  having  stabihzed  at  0.2  percent. 

As  noted,  the  race/ethnic  origin  of  principal  investigators  seeking  NIH  support  is  requested  in  the  apphcation  form,  and  subsequently 
stored  in  encrypted  form  in  the  IMPAC  data  system.  Providing  this  information  is  voluntary  and  it  is  separated  from  the  grant  apphcation 
prior  to  review.  Response  to  this  item  has  been  78  to  91  percent  since  1983.  (In  1983,  racial  information  was  recorded  for  only  72 
percent  of  apphcations  due  to  a data  processing  error.)  Response  rates  had  generaUy  been  on  the  rise  through  1991,  only  to  drop  sharply 
in  1992.  Despite  the  20  percent  nonresponse  to  this  item,  captured  data  are  reported  since  they  are  the  only  available  indication  of  the 
number  and  priority  scores  of  apphcations  submitted  by  minorities  for  DRG  review.  Until  response  to  this  item  improves,  data  on  race 
are  an  approximation. 


Response  Rate  to  Ethnicity  Question 


1983 

71.5 

1985 

79.7 

1987 

78.3 

1989 

85.4 

1991 

90.7 

1992 

81.6 

83 


DRG  Study  Section  Action  on  Competing  R01  Applications 
by  Race/Ethnic  Origin  of  Investigator,*  FY1992** 


100-  175  H 176-200  E3  201  -500  □ NRFC 


White 


Hispanic 


Biack 


Asian/Pacific  Isiander 


Number 


9,902 


240 


95 


1,217 


‘With  response  to  race/ethnic  origin. 

“Competing  applications  summarized  by  requested  start  date  or  fiscal  year  of  funds. 
Source:  NIH,  DRG,  ISB,  SAES 
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4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


From  the  time  racial  data  for  principal  investigators  first  became  available  in  1982,  aU  racial/ethnic  groups  have  shown  similar  trends 
in  their  proportions  of  appHcations  in  the  100-175  priority-score  range  and  in  their  proportion  of  approvals,  though  the  proportions 
themselves  have  differed.  The  groups’  proportions  in  the  100-175  priority-score  range  have  also  ranked  about  the  same  relative  to  each 
other.  The  impact  of  the  NRFC  classification  has  also  been  sizeable. 

There  have  been  clear  differences  among  the  racial  groups.  In  1992,  ROl  appUcations  which  were  classified  as  NRFC  ranged  from  20.3 
percent  for  Whites  to  48.4  percent  for  Black  appUcants.  The  proportion  of  reviewed  appUcations  from  minorities  with  scores  between 
100-175  ranged  from  25.9  percent  for  Asian/Pacific  Islanders  to  12.6  percent  for  Blacks. 


Percentage  Disapproved*/NRFC  Percentage  100-175* 


1983 

1985 

1987 

1989 

1991 

1992 

1983 

1985 

1987 

1989 

1991 

1992 

Asian/Pac.  Is. 

14 

11 

8 

4 

3 

26 

23 

29 

36 

21 

27 

26 

Black 

29 

24 

19 

10 

8 

48 

16 

14 

20 

10 

15 

13 

Hispanic 

18 

7 

7 

4 

4 

29 

24 

31 

30 

24 

25 

26 

White 

12 

8 

5 

3 

2 

20 

28 

34 

41 

26 

33 

30 

*Percentage  of  reviewed  appUcations  summarized  by  fiscal  year  of  funds  or  requested  start  date  from  success  rate  file. 

Minority  appUcants  show  substantiaUy  different  degree  profiles.  AppUcants  of  Hispanic  origin  clearly  have  the  highest  proportion  of 
M.D.’s  — double  those  of  other  minorities,  and  occasionaUy  over  40  percent.  AppUcants  of  Asian/Pacific  Island  origin  report  the  highest 
proportion  with  Ph.D.’s  - between  79  and  84  percent. 


Asian/ 

Pacific  Is.  Black  Hispanic  White 


M.D. 

Ph.D. 

M.D. 

Ph.D. 

M.D. 

Ph.D. 

M.D. 

Ph.D. 

1983 

19.5 

79.3 

22.5 

71.6 

40.5 

58 . 1 

28.0 

70.1 

1985 

16.4 

81.3 

23 . 1 

72 . 7 

39.4 

58.9 

26.0 

71.9 

1987 

18.9 

79.9 

25.6 

67.1 

42.3 

56.7 

25.7 

72 . 2 

1989 

17.7 

81.6 

21.4 

77.4 

41.2 

56.2 

25.9 

72.7 

1991 

19.1 

80.0 

26.6 

69.7 

38.9 

58.4 

26.1 

72.7 

1992 

16.6 

83 . 2 

20.2 

74.7 

43.4 

55.4 

25.1 

74 . 1 

(M.D.’s  include  joint  M.D./Ph.D.  Other  degrees  are  not  shown.) 
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Mean  Priority  Scores  for  DRG-Reviewed  Competing  R01  Applications* 
by  Race/Ethnic  Origin  of  Principal  Investigator,  FY1985  and  FY1992 


FY1992  m FY1985 


Number 

Rated 


Black 


Am.  Indian/Alaskan  Native 


Asian/Pacific  Islander 


White 


Hispanic 


49 

77 

18 

22 

903 

1,009 

7,893 

9,933 

170 

197 


‘Competing  applications  summarized  by  requested  start  date  of  fiscal  year  of  funds.  6/1 5/94 

Source:  NIH,  DRG,  ISB,  SAES  W45cg3 
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4.  Principal  Investigator  Characteristics  Related  to  Study  Section  Action 


Hispanics  and  Asian/Pacific  Islanders  have  better  mean  scores  than  Blacks  and  American  Indian/ Alaskan  applicants*.  The  mean  scores 
of  approved  ROl  appHcations  submitted  by  members  of  racial/ethnic  minorities  summarize  relationships  previously  seen  in  their  score 
distributions  (pp.  82f.). 


Am.  Ind. /Alaskan  Native 
Asian/Pacific  Islander 

Black 

Hispanic 

White 

Total 


1992 

Total 

New 

im — 

Competing 

Continuation 

5T9F 

.223 

.219 

233 

193 

, .240 

250 

214 

.209 

222 

190 

, .214 

228 

190 

.214 

228 

191 

Although  numerous  factors  contribute  to  the  differences  in  scores,  the  small  number  of  appUcations  from  aU  minority  groups  except  Asian/ 
Pacific  Islanders  and  the  lack  of  complete  data  concerning  race/ethnic  origin  make  conclusive  analysis  impossible.  The  following  success 
rates  are  based  on  reviewed  appUcations  recorded  in  the  success  rate  file  and  generaUy  agree  with  the  trends  the  mean  scores  suggest. 


1992 

Competing 


Am.  Ind. /Alaskan  Native.. 

Total 

. . .28.6 

New 

— 5T3T 

Continuation 

3T5C 

Asian/Pacific  Islander... 

. . .23.6 

17.1 

39.7 

Black 

...12.6 

7.8 

33 . 3 

Hispanic 

. . .24.6 

16.3 

43 . 2 

White 

. . .27.8 

20.4 

42 . 8 

Total 

. . .27.3 

20.3 

41.6 

*By  fiscal  year  of  funds  or  requested  start  date  from  success  rate  file. 
Fewer  than  15  appUcations. 
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5.  APPUCANT  INSnrunON  RELATED  TO  STUDY  SECTION  ACTION 

Rank  of  institution 

Distribution  of  applications 
Study  section  actions;  Score  distributions 
Type  of  institution  related  to  mean  priority  scores 
Basic  versus  clinical  departments  (higher  education) 

Mean  priority  score  trends 
Department  of  applicant  (higher  education) 

Mean  priority  score  trends 


f 


Distribution  of  DRG-Reviewed  Competing  R01  Appiications* 
by  Institution  Rank,**  FY1985  and  FY1992 


Percent 


New 


50 


25 


0 


1992 


1985 


Number:  11,738  10,798 


Competing 

Continuation  Total 


1985  1992 

4,682  5,192 


Greater  than  60 


41  - 60 


21  -40 


Top  20  Institutions 


1985 


1992 

15,990 


90 


*Excludes  withdrawals  and  supplements.  Includes  original  and  amended  applications  summarized  by 
fiscal  year  of  initial  review.  ‘‘Institutions  ranked  by  total  R01  dollar  support  in  indicated  year. 

Source:  NIH,  DRG,  ISB,  SAES 


7/1 1/94 
W46cg3 


5.  ^plicant  Institution  Related  to  Study  Section  Action 


About  one-fourth  of  the  ROl  appHcations  reviewed  by  DRG  study  sections  in  1992  were  from  the  top  20  grantee  institutions  (ranked 
by  ROl  dollar  support  within  that  year).  They  submitted  3,876  appHcations  or  an  average  of  194  per  institution.  The  second  20  institu- 
tions submitted  15  percent  — 2,459  appHcations  or  123  per  institution.  Therefore,  in  1992,  the  top  20  institutions  submitted  57.6  percent 
more  appHcations  than  the  next  20.  The  top  40  institutions  also  submitted  a large  share  of  competing  continuations  - 45.6  percent  in 
1985  and  43.1  percent  in  1992. 

Although  the  proportion  of  appHcations  from  the  top  institutions  has  remained  relatively  stable  since  1985,  both  the  total  number  and 
the  average  number  per  institution  have  changed  as  foUows; 

Change 


Institution 

1985 

1992 

1985- 

1992 

Rank 

No. 

Ava.  * 

No. 

Ava.  * 

No. 

Ava. 

1-20 

3,982 

199 

3,876 

194 

-106 

-5 

21-40 

2,478 

124 

2,459 

123 

-19 

-1 

41-60 

2 , 098 

105 

2 , 281 

114 

+183 

+9 

61-100 

2 ,719 

68 

2,704 

68 

-15 

0 

over  100 

5,141 

4,670 

-471 

By  fiscal  year  of  IRG  review. 
Average  per  institution. 


Some  of  the  increase  since  1985  is  due  to  growth  in  amended  appHcations,  particularly  for  the  top  institutions.  In  the  top  20,  for  example, 
amendments  were  23  percent  of  total  appHcations  in  1985,  31  percent  in  1992.  The  average  number  of  nonamended  versus  amended 
ROl  appHcations  per  institution  is  as  foUows: 


Institution  Nonamended  Applications  Amendments 


Rank 

1985 

1992 

1985-92 

1985 

1992 

1985-92 

1-20 

154 

129 

-25 

45 

61 

+16 

21-40 

95 

77 

-18 

23 

41 

+18 

41-60 

78 

69 

-9 

27 

38 

+11 

61-100 

51 

43 

-8 

35 

23 

-12 

91 


DRG  Study  Section  Action  on  Competing  R01  Appiications* 
by  Type  and  Institution  Rank,  FY1992 


Institution 

Rank** 

Top  20 


New 

Applications 


Over  1 00 


^ 12.6 


100-  175  H 176-200  E3  201  -500  □ NRFC 


53.0 


“T~ 

50 


~T~ 

75 


9.0 


Number  of 
Applications 

2,473 

1,622 

1,533 

1,840 

3,330 


100% 


Top  20 


Competing 

Continuations 


21  -40 


41-60 


61-100 


Over  1 00 


1.403 

837 

748 

864 

1,340 


‘Excludes  withdrawals  and  supplements.  Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review. 
"Institution  ranked  by  total  R01  dollar  support  in  F/1992. 

Source:  NIH,  DRG,  ISB,  SAES 


2/23/94 

W47cg3 
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5.  ^plicant  Institution  Related  to  Study  Section  Action 


In  addition  to  submitting  more  applications,  the  top-ranked  institutions  submitted  a higher  proportion  of  appUcations  that  fared  better 
in  study  section  review.  In  1992,  the  percentage  of  new  apphcations  from  the  top  20  institutions  which  received  scores  of  100-175  was 

25.4  percent,  versus  15.3  percent  from  institutions  ranked  after  the  top  100.  (A  total  of  827  institutions  submitted  ROl  apphcations  for 
DRG  review.)  Corresponding  figures  for  1992  competing  continuations  with  scores  of  100-175  were  46.1  percent  for  the  top  20  versus 

36.5  percent  for  those  ranked  after  the  top  100.  All  groups  have  shown  higher  (poorer)  scores  since  1985,  with  the  greatest  increase 
occurring  in  competing  continuation  scores. 

Percentage  with  Scores  100-175 

New  Applications  Competing  continuations 


Institution 

Rank* 

1985 

1992 

Diff . 
85-92 

1985 

1992 

Diff. 

85-92 

1-20 

31.2 

25.4 

-5.8 

57.4 

46.1 

-11.3 

21-40 

28.6 

24.7 

-3.9 

55.7 

43.7 

-12.0 

41-60 

27.4 

20.2 

-7.2 

52 . 1 

39.2 

-12.9 

61-100 

24.4 

20.2 

-4 . 2 

50.4 

39 . 6 

-10.8 

over  100 

23 . 5 

15.3 

-8 . 2 

45.4 

36.5 

-8.9 

Total 

25.5 

20.6 

-4.9 

52.2 

41.2 

-11.0 

In  1992,  the  percentage  of  competing  continuations  deemed  NRFC  ranged  from  2.9  to  5.1  percent  for  aU  ranking  categories.  Both  new 
and  competing  continuations  had  substantiaUy  more  not  rated  apphcations  since  1985. 


Percentage  Disapproved /NRFC 


New  Applications 


Competing  continuations 


Institution 


Rank* 

1985 

1992 

1-20 

6.7 

9.0 

21-40 

7.8 

10.0 

41-60 

8.0 

12.5 

61-100 

9.0 

13.2 

over  100 

14.5 

20.5 

Total 

10.0 

13.9 

Dif f . Dif f . 


85-92 
2 . 3 

1985 

1.9 

1992 

3.3 

85-92 

1.4 

2.2 

1.0 

3.0 

2.0 

4.5 

1.4 

3.9 

2.5 

4.2 

1.3 

2.9 

1.6 

6.0 

2.7 

5.1 

2.4 

3.9 

1.8 

3.8 

2.0 

*Ranked  by  total  ROl  doUar  support.  Reviewed  apphcations  by  fiscal  year  of  IRG  review. 
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Mean  Priority  Scores  of  DRG-Rated  R01  Applications* 
by  Kind  of  Institution,  FY1 983-1 992 


Mean  Score 


‘Excludes  withdrawals  and  supplements.  Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review. 
Source:  NIH,  DRG,  ISB,  SAES 


5/23/94 

W48cg3 


5.  ^plicant  Institution  Related  to  Study  Section  Action 


Medical  schools  and  schools  in  the  "other  higher  education"  category  submitted  by  far  the  largest  share  of  DRG -rated  ROl  apphcations 
- 52  and  21  percent,  respectively,  in  1992.  The  priority  scores  of  applications  from  most  types  of  institutions  have  shown  improvement 
since  1983,  with  the  largest  change  (10  points)  in  independent  hospitals.  (Other  health  professional  schools  include  dentistry,  osteopathy, 
chiropractic,  pharmacy,  physical  therapy,  optometry,  nursing,  podiatry,  university  hospitals,  veterinary  medicine,  home  economics/human 
ecology,  nutrition,  and  aUied  health  professions.) 

ROl  apphcations  from  research/other  nonprofit  organizations  scored  better  than  apphcations  submitted  by  other  institutions  in  1992. 
Differences  between  the  best  and  the  worst  average  scores  ranged  from  20  points  in  1983  to  21  points  in  1992.  The  number  of  ROl 
apphcations  from  for-profit  organizations  was  fewer  than  100  each  year,  and  showed  extremely  variable  score  distributions  and  success 
rates. 


Rated 

Aoioli cat  ions 

Rated 

Mean 

Scores 

1983 

1988  1992 

1983 

1988 

1992 

Medical  Schools 

6,839 

6,784 

7,395 

236 

226 

230 

Other  Health  Prof. 

958 

1,102 

1,343 

251 

240 

242 

Other  Higher  Education 

3,117 

3,145 

2,932 

231 

230 

228 

Independent  Hospitals 

904 

1,006 

1,096 

238 

230 

228 

Res.  & Other  Nonprofit 

1,228 

1,084 

1,291 

233 

229 

226 

Profit  Organizations 

25 

45 

58 

236 

251 

247 

Total 

13,071 

13,166 

14,115 

236 

229 

230 

Priority  ratings  are  among  the  factors  that  influence  apphcations’  success  in  obtaining  funding.  The  foUowing  success  rates  are  compiled 
from  the  award  rate  file,  which  deletes  the  initial  apphcation  if  an  amendment  is  reviewed  in  the  same  fiscal  year.  Additionahy,  these 
data  reflect  fiscal  year  of  funding  or  requested  funding,  not  fiscal  year  of  review. 


1983 

1988 

1992 

Medical  Schools 

32.2 

33 . 1 

27.4 

Other  Health  Prof. 

27.4 

28.8 

22.9 

Other  Higher  Education 

33.9 

31.7 

27.9 

Independent  Hospitals 

28.7 

32.7 

27.8 

Res.  & Other  Nonprofit 

30.6 

37.1 

29.0 

Profit  Organizations 

25.6 

26.0 

16.0 

Total 

31.9 

32.7 

27.3 

95 


Mean  Priority  Scores  of  DRG-Reviewed  Competing  R01  Applications* 
from  Basic  versus  Clinical  Departments**,  FY1 983-1 992 


Mean  Score 


'Excludes  withdrawals  and  supplements.  Includes  original  and  amended  applications  summarized  by  fiscal  year  of  inital  review. 
"Institutions  of  higher  education  only. 

Source;  NIH,  DRG,  ISB,  SAES 


5/23/94 

W49cg3 


5.  ^plicant  Institution  Related  to  Study  Section  Action 


Since  1975,  about  half  (51  to  55  percent)  of  the  ROl  applications  from  institutions  of  higher  education  have  come  from  basic  science 
departments.  (See  Technical  Note  16  for  operational  definitions  of  "basic"  and  "clinical";  "other"  departments  are  defined  as  the  logical 
complement  to  these.)  An  additional  29  to  32  percent  were  from  clinical  science  departments,  leaving  15  to  17  percent  from  aU  other 
departments.  Apphcations  from  basic  science  departments  received  average  scores  that  were  about  10  to  20  points  better  (lower)  than 
those  from  clinical  departments.  Clinical  and  "other"  departments  had  similar  scores  until  1982,  when  a gap  developed  as  "other"  depart- 
ments’ scores  failed  to  improve  as  much.  Score  levels  of  the  three  types  of  science  departments  differ,  but  they  show  parallel  changes 
over  time. 


Number  Reviewed 

Year  Basic  Clinical 

1983 6,451  3,958 

1985 7,141  4,379 

1987 5,907  3,588 

1989 6,581  4,093 

1991  6,132  4,020 

1992  6,492  4,338 

1983-92 +41  -H380 


Mean  Scores 


Other 

Basic 

Clinical 

Other 

1,870 

226 

246 

251 

1,992 

217 

231 

253 

1,846 

207 

220 

240 

2,169 

237 

247 

263 

1,934 

221 

234 

249 

1,967 

223 

236 

245 

-1-97 

-3 

-10 

-6 

*From  institutions  of  higher  education;  by  fiscal  year  of  IRG  review. 


Different  types  of  institutions  have  different  proportions  of  applications  from  the  three  types  of  science  departments. 


Number  Reviewed Mean  Scores 


Department  Tvoe 

Basic 

Clinical 

Other 

Basic 

Clinical 

Other 

Medical  Schools 

1990 

.3,581 

3,735 

186 

226 

239 

231 

1991 

.3,679 

3,730 

232 

221 

234 

236 

1992 

.3,900 

4,012 

195 

223 

236 

231 

Other  Health  Prof 

• 

1990 

. 416 

193 

914 

233 

241 

263 

1991 

. 467 

229 

793 

232 

235 

256 

1992 

. 488 

235 

823 

230 

244 

248 

Other  Higher  Ed. 

1990 

.2,285 

131 

919 

225 

251 

250 

1991 

.1,986 

61 

909 

219 

218 

247 

1992 

.2,104 

91 

949 

221 

219 

246 

97 


Mean  Priority  Scores  of  DRG-Reviewed  Competing  R01  Appiications* 
by  Department**  of  Principai  Investigator,  FY1 983-1 992 


Mean  Score  Clinical  Science  Mean  Score  Basic  Science 


98 


*Excludes  withdrawals  and  supplements.  Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review. 

**lnstitutions  of  higher  education  only  (domestic). 

Source:  NIH,  DRG,  ISB,  SAES 


5/23/94 

W50cg3 


5.  i^plicant  Institutioii  Related  to  Study  Section  Action 


Considerable  score  variation  exists  among  the  academic  departments  that  are  grouped  in  the  broad  categories  of  basic  or  clinical  sciences. 
Aside  from  some  expected  overlap,  however,  appHcations  from  specific  basic  science  departments  average  better  scores  than  those  from 
clinical  science  or  "other"  departments.  AppUcations  from  departments  of  chemistry,  biochemistry  and  genetics  (basic  science)  averaged 
the  best,  with  remarkably  similar  scores  throughout  the  past  decade.  Departments  such  as  medicine,  neurology,  dentistry,  and  veterinary 
science  show  mean  scores  that  roughly  overlap  the  high  end  of  the  basic  science  departments’  score  range.  Other  cHnical  departments, 
such  as  surgery,  pubHc  health  and  ophthalmology  have  poorer  average  scores. 


Number  Approved  Number  Approved 


Department 
IHicfher  Ed. ) 

Reviewed* 

Mean 

Score 

Department 
(Hiaher  Ed.) 

Reviewed* 

Mean 

Score 

1983 

1992 

1983 

1992 

1983 

1992 

1983 

1992 

Clinical  Science 

3,676 

4,048 

247 

237 

Basic  Science 

6,237  < 

5, 208 

226 

222 

Medicine 

1,654 

1,826 

237 

230 

Biochemistry 

1,235  : 

L,  186 

214 

215 

Neurology 

190 

247 

254 

234 

Chemistry 

693 

690 

216 

218 

Radiology 

222 

315 

247 

235 

Genetics 

143 

222 

217 

218 

Ob. -Gynecology 

200 

204 

237 

239 

Zoology 

144 

125 

231 

219 

Pediatrics 

433 

426 

260 

242 

Microbiology 

706 

793 

226 

221 

Psychiatry 

139 

121 

257 

248 

Anatomy 

557 

420 

228 

222 

Surgery 

425 

412 

263 

248 

Biology 

796 

822 

230 

225 

Public  Health 

264 

301 

257 

250 

Pathology 

531 

600 

236 

227 

Ophtha Imo 1 ogy 

149 

196 

242 

252 

Pharmacology 

745 

682 

239 

227 

Physiology 

687 

668 

231 

230 

Other 

1,395 

1,410 

251 

246 

Dentistry 

133 

154 

255 

225 

Veterinary  Science  114 

164 

248 

228 

Miscellaneous 

288 

265 

250 

242 

Engineering  (all) 

198 

196 

250 

247 

Psychology 

372 

284 

249 

250 

Nutrition 

134 

104 

261 

263 

Other  Health  Prof. 

156 

243 

251 

264 

*Selected  departments  ranked  by  1992  mean  score;  by  fiscal  year  of  IRG  review. 
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6.  PERCENTILE  RANK  TRENDS 

Logic  for  Rank  Assignment 
Distributional  Trends 

New  versus  Competing  Continuations  Trends 
Percentile  Ranks  and  Requested  Years  of  Support 
Percentile  Ranks  by  DRG  Review  Sections 
Percentile  Ranks  by  Institutes  and  Centers 


Funding  Mechanisms  Subject  to  Percentile  Ranking 


Code 

F05* 

F06* 

F07* 

F15 

F20* 

F30 

F31 

F32* 

F33* 

F34 

F35 

F36 

F37 

F38 

MOl 

POl* 

P20 

P30 

P40 

P41 

P42 

P50 

P60 

ROl* 


Mechanism 

Intomational  Researdi  Fdlowships 
Senior  International  Fdknvships 

NIH  - French  CNRS  Program  for  Scientific  Collaboration 
Scholars-in-Residence  Program 
Foreign  Funded  Fellowships 

Individual  Predoctoral  National  Research  Service  Award  (NRSA)  for 
M.D./Ph.D.  Fellowships 

Predoctoral  Individual  National  Research  Service  Award 

Postdoctoral  Individual  National  Research  Service  Award 

NatitMial  Research  Service  Award  for  Senior  Fellows 

Minority  Access  to  Research  Careers  (MARC)  NRSA  Faculty  Fellowships 

Intramural  NRSA  Individual  Postdoctoral  Program  Appointees 

MARC  Visiting  Scientist  Fellowships 

Medical  Informatics  Fellowships 

Applied  Medical  Informatics  Fellowships 

General  Clinical  Research  Centers  (NCRR) 

Research  Program  Projects 
Exploratory  Grants 
Center  Core  Grants 

Animal  Model/ Animal  and  Biological  Material  Resource  Grants 

Biotechnology  Resource  Grant  Program 

Hazardous  Substances  Basic  Research  Grants  Program 

Specialized  Center  Grants 

Comprehensive  Center  Grants 

Research  Projects 


Code  Mechanism 

R03  Small  Research  Giants 

RIO  Cooperative  Clinical  Research  Grants 

R18  Research  Demonstration  and  Dissemination  Projects 

R21  E]q>Ioratoiy/Devd(^mental  Giants 

* 

R22  U^.  - Japan  Cooperative  Medical  Science  Program 

* 

R24  Resource  HeJated  Research  Projects 


R25  Education  Projects 

R29  First  Indqtendent  Research  Support  and  Transirion  (FIRST)  Awards 

R35  Outstanding  Investigator  Grants 

R37  Method  to  Extend  Research  in  Time  (MERIT)  Awards  {see  note  below) 

S06  Minority  Biomedical  Research  Support 

SIO  ffiiHnedical  Research  Support  Shared  Instiumentation  Giants 

* 

UOl  Research  Project  (Cooperative  Agreements) 

UlO  Cooperative  Clinical  Research  (Cooperative  Agreements) 

in  3 Conference  (Cooperative  Agreements) 

U18  Research  Demonstration  (Cooperative  Agreements) 

U24  Resource-Related  Research  Project  (Cooperative  Agreements) 

U41  Biotechnology  Resource  (Cooperative  Agreements) 

U42  Animal/Biological  Materials  Resource  Cooperative  Agreements 

U45  Hazardous  Waste  Worker  Health  and  Safety  Training  Cooperative  Agreements 

U54  Specialized  Center  (Cooperative  Agreements) 

U76  Area  Health  Education  Centers  (Cooperative  Agreements) 

U88  Services  Demonstration  (Cooperative  Agreements) 


Mechanism  data  used  in  Chapter  calculations.  N.B.  F mechanisms  (fellowships)  are  subject  to  percentile  ranking  only  if  reviewed  by  DRG.  R37  and  R55  grants  have  percentile  ranks,  but  these  scores 
were  derived  when  the  application  was  originally  reviewed  (generally,  as  an  ROl).  If  reviewed  by  an  ICD,  the  percentile  may  not  appear  on  the  summary  sheet,  and  is  generally  percentiled  against  the 
DRG  base. 


6.  Percentile  Rank  Trends 


As  the  chart  suggests,  there  are  a number  of  funding  mechanisms  potentially  subject  to  percentile  ranking.  Before  presenting  percentile 
data,  it  is  appropriate  to  review  some  of  the  concepts  and  procedures  involved  in  their  calculation.  The  percentile  (pj)  represents  the 
relative  position  or  rank  of  each  priority  score  (along  a 100.0  percentile  band)  among  the  applications  reviewed  by  the  particular  initial 
review  group  (IRG)  at  the  current  meeting  and  the  two  previous  meetings.  If  N apphcations  of  each  IRG  are  assigned  a numerical  rank 


(r)  in  ascending  order  of  priority  score,  then  Py=(-^)x(r— 


The  percentile  is  the  same  as  the  cumulative  percent  distribution  of 


the  apphcations  reviewed  by  each  IRG,  and  indicates  the  percent  of  reviewed  apphcations  with  scores  equal  to  or  better  than  that 
particular  apphcation.  For  example,  a percentile  rank  of  25.0  indicates  that  25  percent  of  the  apphcations  reviewed  by  that  IRG  received 
equal  or  better  (lower)  scores.  Tie  scores  are  each  given  the  same  (middle)  percentile  rank.  It  is  important  to  note  that  this  is  a reversal 
of  the  usual  percentile  interpretation,  made  in  order  to  correspond  to  the  priority  score  rating  system  in  which  lower  scores  indicate  better 
apphcations. 


To  be  "qualified"  for  the  percentile  computation,  chartered  IRGs  must  have  met  for  three  consecutive  rounds  (including  the  current  round) 
in  which  they  scored  a cumulative  total  of  at  least  25  apphcations.  Review  groups  not  meeting  these  requirements  are  percentiled  on 
the  basis  of  their  position  among  the  priority  scores  of  aU  qualifying  IRG’s  which  comprise  the  base  for  what  is  caUed  the  "Total  Table." 
The  "Total  Table"  to  be  used  is  determined  by  the  ICD/agency  reviewing  the  apphcation.  Different  bases  can  be  used  for  percentihng. 
These  bases  are  more  extensively  discussed  in  the  appendix.  Since  the  data  in  this  chapter  is  restricted  to  DRG  chartered  study  sections, 
the  foUowing  excerpt  is  germane. 


DRG  Chartered  Study  Sections.  Competing  R,  P,  and  U applications  (excluding  R13,  R15,  R43,  R44,  R55,  U43,  and  U44  activities) 
reviewed  by  chartered  DRG  study  sections  are  percentiled  against  their  own  base  if  they  have  met  the  qualifications  described  above. 
The  base  includes  applications  reviewed  in  the  current  and  prior  two  meetings.  It  also  includes  any  applications  reviewed  by  ad  hoc, 
special  emphasis  panels  (SEP’s)  or  special  study  sections  which  have  designated  a parent  study  section  in  the  prior  rounds.  (For  a 
definition  of  parent  study  section,  see  the  cases  used  for  percentihng  in  the  appendices.) 

For  further  information  concerning  percentile  rank  assignment,  the  appendices  provide  a useful  starting  point. 
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Percentile  Rank  Intervals  for  NIH  Competing  Applications* 
Rated  by  DRG-Chartered  Study  Sections,  FY1 988-1 992 


1 


0 5,000  10,000  15,000  20,000 

Number  of  Applications 


*Original  and  amended  applications  summarized  by  fiscal  year  of  initial  review;  excludes  withdrawals 
and  supplements. 

Source:  NIH,  DRG,  ISB,  SAES 
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6.  Percentile  Rank  Trends 


While  the  focus  elsewhere  in  this  pubHcation  is  generally  confined  to  ROl -related  data,  this  chapter  expands  its  focus  to  include  aU  DRG- 
reviewed  percentile  data.  It  remains  chiefly,  however,  ROl  data  (85.2  percent)  and  R29  data  (9.8  percent).  The  remaining  five  percent 
of  the  data  is  related  to  the  other  15  activities,  as  noted  in  the  first  chart  of  this  chapter. 

As  the  chart  opposite  suggests,  percentiling  ROl  applications  has  stabilized  their  score  distributions  rather  effectively.  This  analysis  uses 
percentile  ranks  from  the  80-plus  DRG  chartered  study  sections  only,  because  percentiles  are  computed  within  and  for  each  of  these  review 
panels.  Applications  reviewed  by  non-chartered  study  sections  do  not  always  use  an  aggregate  DRG  base  for  computing  their  percentile 
ranks,  and  so  were  omitted  from  this  analysis.  Generally,  the  data  are  grouped  by  deciles,  or  ten-point  ranges.  For  the  most  part,  both 
within  deciles  (across  years)  and  across  deciles  (within  years),  there  is  remarkable  consistency  in  the  percentages. 

Nevertheless,  there  is  still  evidence  of  the  changes  seen  with  priority  scores.  That  is,  more  appHcations  received  better  percentile  ranks 
in  1992  than  in  1988.  It  is  not  clear  whether  this  is  simply  the  result  of  more  ties,  or  changes  in  the  density  of  the  priority  score  dis- 
tributions. One  might  expect,  naively,  to  have  seen  about  2,100  appUcations  in  1992  in  the  first  decile.  Instead,  there  were  over  2,400. 
The  first  decile  grew  by  0.4  percent  over  the  first  5 years  of  percentile  ranks,  while  the  proportion  of  scores  in  the  worst  half  of  the  distri- 
bution declined.  One  conclusion  from  these  data  is  that  it  is  inappropriate  to  equate  percentile  ranks  with  percentage  of  all  scores. 

1988  1989  1990  1991  1992  1988-92 

Percentile 

Rank 


Intervals 

N 

% 

N 

% 

N 

% 

N 

% 

N 

% 

N 

% 

0 - 5 

962 

5.9 

1,134 

6.3 

1,325 

7.3 

1,157 

6.4 

1,307 

6.2 

4-345 

-1-0.3 

6 - 10 

861 

5.3 

934 

5.2 

1,026 

5.7 

940 

5.2 

1,131 

5.4 

-1-270 

-t-0.1 

11  - 20 

1,590 

9.8 

1,893 

10.5 

1,836 

10.1 

1,864 

10.3 

2,141 

10.2 

-f-551 

-t-0.4 

21  - 30 

1,557 

9.6 

1,736 

9.6 

1,814 

10.0 

1,950 

10.8 

2,215 

10.6 

-t-658 

-t-1.0 

31  - 40 

1,537 

9.5 

1,737 

9.6 

1,897 

10.5 

1,870 

10.3 

2,204 

10.5 

-1-667 

-1-1.0 

41  - 50 

1,577 

9.7 

1,811 

10.0 

1,809 

10.0 

1,769 

9.8 

2,112 

10.1 

-1-535 

-t-0.4 

51  - 100 
Disapproval/ 

7,464 

46.0 

8,178 

45.3 

8,086 

44.5 

8,088 

44.7 

7,733 

36.8 

-1-269 

-9.2 

NRFC 

N 

604 

16,152 

3.7 

429 

17,852 

2.4 

353 

18,146 

1.9 

419 

18,057 

2.3 

2,105 

20,948 

10.0 

1,501 

-H4,796 

4-6.3 
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NIH  Competing  Applications*  Rated  by  DRG-Chartered  Study  Sections 
by  Type  and  Percentile  Rank  Intervals,  FY1 988-1 992 
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Number 

15,000-1^ 


12,500 


10,000- 


7,500-- 


5,000-- 


2,500 


Competing  Continuations 


|X 

7 

p 

? 

SWWWW' 

y > 

/ 

/ 

WSWWWN 

WSNSSSW'f 

/ 

1988 

1989 

1990 

1991 

1992 

1988 

1989 

1990 

1991 

1992 

Mean: 

54.7 

53.3 

51.5 

51.6 

47.0 

38.5 

37.8 

37.1 

38.4 

35.2 

‘Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review.  Excludes  withdrawals  and  supplements. 
Source:  NIH,  DRG,  ISB,  SAES 
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6.  Percentile  Rank  Trends 


These  data  continue  to  demonstrate  the  advantage  that  competing  continuation  applications  enjoy  with  percentile  ranks.  Most  striking 
about  these  distributions  are  the  by  far  larger  proportions  of  the  new  apphcations  which  fall  in  the  bottom  half  of  the  rankings  (see  the 
category  "51  and  Above".)  The  relative  values  of  the  means  also  corroborate  this  conclusion.  Given  that  competing  continuation  applica- 
tions have  previously  demonstrated  their  scientific  worth  (and  received  funding),  this  is  not  altogether  surprising. 


Percentile  Rank  Interval 


Year 

0.0  - 
10.9 
N 

11.0  - 
20.9 
N 

21.0  - 
30.9 
N 

31.0  - 
40.9 
N 

41.0  - 
50.9 
N 

51  and 
Above 
N 

Rated 

Mean  Median 

1988 

874 

876 

874 

952 

1,066 

5,819 

54.7 

56.7 

1989 

1,055 

1,090 

1,080 

1,130 

1,281 

6,502 

53.3 

54.5 

New 

1990 

1,270 

1,090 

1,170 

1,303 

1,297 

6,466 

51.5 

52.3 

1991 

1,139 

1,112 

1,229 

1,245 

1,208 

6,357 

51.6 

52.7 

1992 

1,396 

1,372 

1,479 

1,563 

1,565 

6,308 

47.0 

47.7 

1988 

949 

714 

683 

585 

511 

1,645 

38.5 

34.0 

Competing 

1989 

1,013 

803 

656 

607 

530 

1,676 

37.8 

33.6 

Continuation 

1990 

1,081 

746 

644 

594 

512 

1,620 

37.1 

33.1 

1991 

958 

752 

721 

625 

561 

1,731 

38.4 

34.3 

1992 

1,042 

769 

736 

641 

547 

1,425 

35.2 

31.4 

Finally,  the  relationships  between  the  rated  means  and  medians  suggest  an  opposite  skewness  to  the  new  and  competing  continuation 
apphcations.  Where  means  and  medians  differ,  generally  speaking,  the  mean  tends  to  the  more  extreme  tail  while  the  median  more  close- 
ly follows  the  bulk  of  the  distribution.  These  data  suggest  that  the  bulk  of  the  new  apphcations  are  in  the  higher  ranks  (their  annual 
means  are  consistently  above  their  aimual  medians).  Conversely,  the  opposite  trend  is  seen  in  the  competing  continuation  data  (suggest- 
ing that  a preponderance  of  these  data  are  in  the  lower  ranks). 
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NIH  Competing  Applications*  Rated  by  DRG-Chartered  Study  Sections 
by  Requested  Years  of  Support  and  Percentile  Rank  Intervals,  FY1 990-1 992 


Percent  ^ ^ Years 

100 


75 

50 

25 


0 

Number:  489  1,008  2,323 


3-4  Years 


— I I I — 

1990  1991  1992 

6,092  5,825  7,399 


5 or  More  Years 


yyyyyyy, 

fyyyyyyy, 

*yyyyyyy. 


Disapproved/NRFC 


- 31  - 100  Percentile 


T 1 r 

1990  1991  1992 


21  - 30.9  Percentile 


1 1 - 20.9  Percentile 


0-10.9  Percentile 


9,031  9,204  8,737 


‘Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review.  Excludes  withdrawals  and  supplements. 
Source:  NIH,  DRG,  ISB,  SAES 
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6.  Percentile  Rank  Trends 


As  seen  previously  with  priority  scores,  applications  with  different  requested  years  of  support  have  dramatically  different  percentile  rank 
distributions.  Requests  for  5 or  more  years  of  support  have  much  better  percentile  ranks  than  do  requests  for  3 or  4 years,  and  even  more 
so  than  requests  for  only  1 or  2 years. 


Number  of  Applications 


Length  of  Requested  Support* 


Percentile 

Rank 

1 - 2 Years 

3 - 4 Years 

5 or  More  Years 

Interval 

1990 

1991 

1992 

1990 

1991 

1992 

1990 

1991 

1992 

0 - 10.9 

26 

82 

199 

475 

410 

521 

1,386 

1,271 

1,291 

11  - 20.9 

25 

73 

208 

455 

445 

643 

1,052 

1,079 

984 

21  - 30.9 

15 

74 

223 

524 

516 

678 

1,015 

1,108 

1,019 

31  - 100 

366 

705 

1,356 

4,528 

4,300 

4,556 

5,503 

5,648 

4,904 

Disapproved/ 

NRFC 

55 

73 

337 

110 

153 

1,001 

75 

98 

539 

Total 

487 

1,008 

2,323 

6,092 

5,824 

7,399 

9,031 

9,204 

8,737 

Percentages 


1 - 2 Years  3 - 4 Years  5 or  More  Years 


1990 

1991 

1992 

1990 

1991 

1992 

1990 

1991 

1992 

0 - 10.9 

5.3 

8.1 

8.6 

7.8 

7.0 

7.0 

15.3 

13.8 

14.8 

11  - 20.9 

5.1 

7.2 

9.0 

7.5 

7.6 

8.7 

11.6 

11.7 

11.3 

21  - 30.9 

3.1 

7.3 

9.6 

8.6 

8.9 

9.2 

11.2 

12.0 

11.7 

31  - 100 

74.8 

69.9 

58.4 

74.3 

73.8 

61.6 

60.9 

61.4 

56.1 

Disapproved/ 

NRFC 

11.7 

7.3 

14.5 

1.8 

2.6 

13.5 

0.8 

1.1 

6.2 

*Based  on  reviewed  apphcations  by  fiscal  year  of  chartered  DRG  study  section  review. 


Since  1990,  aU  three  segments  have  shown  relatively  constant  distributional  densities.  These  proportions  suggest  that  competing  applica- 
tions requesting  only  1 or  2 years  of  support  face  much  less  hkely  prospects  for  funding.  In  1992,  for  instance,  less  than  18  percent  of 
this  group  were  in  the  "best"  percentile  rank  band  (less  than  21).  At  the  same  time,  over  26  percent  of  the  longest  projects  (five  or  more 
years)  scored  in  the  region  most  hkely  to  receive  support. 
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Percent  of  Competing  Applications*  in  Percentile  Ranks  0-20.9 

by  DRG  Review  Sections,  FY1992 


■ New  Applications  H Competing  Continuations 


Clinical  Sciences 


Behavioral  & Neurosciences 


Physiological  Sciences 


Immunology,  Virology,  & Pathology 


Biomedical  Sciences 


Biological  Sciences 


40% 


‘Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review.  Excludes  withdrawals  and  supplements. 
Source:  NIH,  DRG,  ISB,  SAES 
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6.  Percentile  Rank  Trends 


The  data  suggest  a remarkable  consistency  among  review  sections  in  their  treatment  of  new  applications,  and  a rough  sense  of  equivalence 
in  their  treatment  of  competing  continuations.  The  percentage  of  new  applications  in  the  best  region  ranged  from  13.6  to  18.0  across 
sections  and  years.  At  the  same  time,  the  percentage  of  competing  continuations  in  the  best  region  ranged  from  27.8  to  36.6.  These  re- 
sults demonstrate  (a)  the  relative  comparability  of  the  review  sections,  and  (b)  the  formidable  challenge  that  new  appUcations  continue 
to  have  in  the  competition  for  funding. 


Percent  of  New  and  Competing  Continuation  AppHcations  in  the  Percentile  Ranks  0.0  - 20.9 


Fiscal  Year 
of 

Behavioral/ 

Biological 

Initial 

Neurosciences 

Sciences 

Review 

1988 

13.8 

16.9 

1989 

15.5 

17.8 

New 

1990 

17.7 

16.0 

1991 

15.7 

17.9 

1992 

16.7 

17.2 

1988 

30.7 

32.1 

1989 

28.8 

36.3 

Competing 

1990 

30.9 

36.6 

Continuation 

1991 

31.4 

31.5 

1992 

30.9 

36.4 

1988 

18.9 

21.7 

1989 

19.3 

23.6 

Total 

1990 

21.5 

22.1 

1991 

20.6 

21.9 

1992 

20.8 

21.3 

Immunology, 


Biomedical 

Sciences 

Clinical 

Sciences 

Physiological 

Sciences 

Virology,  and 
Pathology 

13.6 

16.0 

14.8 

16.3 

16.1 

16.6 

16.9 

17.2 

17.0 

17.3 

16.1 

17.5 

15.0 

16.7 

17.3 

18.0 

15.9 

17.3 

16.2 

16.7 

33.9 

29.7 

31.0 

31.8 

33.1 

33.6 

29.2 

35.7 

34.6 

32.7 

33.8 

31.9 

30.7 

31.0 

27.8 

30.3 

34.3 

29.5 

31.4 

33.2 

21.3 

20.0 

19.7 

21.7 

22.0 

21.2 

20.6 

23.1 

23.1 

21.5 

21.4 

21.6 

20.7 

20.7 

20.8 

21.2 

21.7 

20.4 

20.4 

20.8 
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DRG  Study  Section  Action  on  Competing  Appiications'  Percentiie  Ranks* 

by  Assigned  Institute  / Center,  FY1992 


Percent 


40  V 


NIA 

NIEHS 

NCNR 

NCI 

NCHGR  NICHD 

NIDCD 

NHLBI 

NINDS 

NEI 

NIDR 

NIAMS 

NIDDK 

NIAID 

NiGMS 

Number:  622 

445 

165 

2,722 

106  1,325 

442 

2,362 

1,914 

794 

303 

725 

1,787 

1,889 

3,172 
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‘Ranked  by  percent  of  applications  scored  0 to  20.9.  Excludes  withdrawals  and  supplements. 
Includes  original  and  amended  applications  summarized  by  fiscal  year  of  initial  review. 

Source;  NIH,  DRG,  ISB,  SAES 
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6.  Percentile  Rank  Trends 


Given  the  priority  score  distributions  previously  presented,  it  is  not  particularly  surprising  that  percentile  ranks  of  DRG-reviewed  applica- 
tions also  differ  by  assigned  ICD.  Large  differences  are  still  observed. 


Percent  Within  Rank  Intervals,  FY  1992 


0.0 

11.0 

21.0 

31.0 

0.0 

0.0 

to 

to 

to 

to 

to 

to 

Mean 

Median 

ICD 

10.9 

20.9 

30.9 

100.0 

20.9 

30.9 

Percentile 

Percentile 

N 

NIA 

5.5 

7.1 

7.2 

63.7 

12.6 

19.8 

51.1 

53.3 

622 

NIEHS 

8.1 

7.2 

9.2 

58.7 

15.3 

24.5 

48.3 

48.1 

445 

NCNR 

9.7 

7.9 

9.7 

54.5 

17.6 

27.3 

44.7 

45.4 

165 

NCI 

9.4 

9.0 

10.2 

57.8 

18.4 

28.6 

45.0 

44.4 

2,722 

NCHGR 

11.3 

8.5 

9.4 

38.7 

19.8 

29.2 

36.2 

35.8 

106 

NICHD 

9.7 

10.3 

10.8 

55.7 

20.0 

30.8 

43.9 

43.2 

1,325 

NIDCD 

11.1 

9.0 

9.3 

55.2 

20.1 

29.4 

42.9 

41.2 

442 

NHLBI 

10.2 

9.9 

10.3 

57.5 

20.1 

30.4 

44.5 

44.2 

2,362 

NINDS 

11.1 

9.1 

11.5 

57.6 

20.2 

31.7 

45.3 

44.8 

1,914 

NEI 

10.7 

10.1 

9.7 

58.3 

20.8 

30.5 

44.1 

43.8 

794 

NIDR 

11.6 

9.6 

7.6 

60.1 

21.2 

28.8 

45.4 

45.5 

303 

NIAMS 

10.1 

11.4 

11.3 

56.4 

21.5 

32.8 

44.0 

42.8 

725 

NIDDK 

11.6 

10.2 

11.2 

56.4 

21.8 

33.0 

44.0 

42.4 

1,787 

NIAID 

13.1 

8.9 

10.0 

57.2 

22.0 

32.0 

43.4 

42.5 

1,889 

NIGMS 

11.8 

11.4 

9.7 

57.8 

23.2 

32.9 

43.9 

43.0 

3,172 

At  least  in  the  extremes,  it  is  also  interesting  to  note  that  the  order  of  ICDs  arrayed  by  ROl  priority  score  distributions  in  the  100  to  175 
range  (p.  55)  corresponds  roughly  to  the  order  of  ICDs  arrayed  here  by  percentile  ranks  (0.0  to  20.9).  One  of  the  most  striking  transposi- 
tions is  that  of  the  NEI-assigned  apphcations;  there  were  19.9  percent  approved  NEI  ROl  appHcations  with  scores  between  100  and  175, 
which  placed  it  next  to  last. 
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APPENDICES 

• Glossary  of  Terms 

• Bases  Used  for  Percentiling 

• Minority-Targeted  Grant  Activities 

• Definitions  of  Selected  Grant  Activities 

• Other  Publications  of  Interest 


Glossary  of  Terms 


^pendices 


Activity  Code  (coverage)  A code  assigned  by  the  NIH  to  identify  special  groupings  of  support  mechanisms.  General  categories  include 
research  grants,  contracts,  training  programs,  and  fellowships.  Research  grants,  in  turn,  can  be  subdivided  into  research  projects, 
research  centers,  and  other  research  grants.  (For  definitions  of  individual  codes,  see  Activity  Codes,  Organization  Codes  and 
Definitions  Used  in  Extramural  Programs,  January  1994,  NIH  Manual  Issuance  4101/6304-2.) 

ADAMHA  Alcohol,  Drug  Abuse,  and  Mental  Health  Administration.  Effective  October  1992,  the  service  components  of  ADAMHA  were 
assigned  to  the  Substance  Abuse  and  Mental  Health  Services  Administration  (SAMHSA).  The  three  research  components  of 
ADAMHA  became  part  of  the  NIH.  This  added  the  National  Institute  on  Alcohol  Abuse  and  Alcohohsm  (NIAAA),  the  National 
Institute  on  Drug  Abuse  (NIDA),  and  the  National  Institute  of  Mental  Health  (NIMH)  to  the  NIH. 

Amendment  (amended  or  revised  applications)  Resubmission  of  an  unfunded  application  that  has  been  revised  in  response  to  a prior 
review. 

^pHcation  A formal  request  for  support  of  a specific  project  or  comparable  activity. 

^plication  Type  Identifies  form  of  appHcation.  (See  New,  Competing  Continuation,  Noncompeting  Continuation,  and  Stq)plemenL) 

Award  Signifies  that  funds  have  been  obligated,  includes  both  direct  and  indirect  costs  unless  indicated.  (See  Grant) 

BRDPI  Biomedical  Research  & Development  Price  Index.  The  BRDPI  is  developed  for  the  NIH  to  measure  changes  in  the  prices  of  items 
and  services  required  for  its  Research  and  Development  (R&D)  activities.  (See  Constant  Dollars,  Current  Dollars.) 

Competing  Continuation  An  appHcation  which  requires  competitive  peer  review  and  institute/center  action  to  continue  beyond  the  cur- 
rent competitive  segment.  Also  known  as  a Renewal. 

Constant  Dollars  Dollar  amounts  based  on  buying  power  in  a certain  base  year.  The  Biomedical  Research  and  Development  Price  Index 
is  used  to  find  the  constant  dollar  amounts  from  current  dollar  figures.  (See  BRDPI.) 

Contract  A funding  mechanism  in  which  the  NIH  procures  specified  services. 
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Council  Each  Institute/Center  that  awards  grants  has  a statutorily  mandated  National  Advisory  Council  or  Board  that  provides  the  second 
level  of  review  for  grant  appHcations.  The  Councils/Boards  are  comprised  of  both  scientific  and  lay  representatives.  Council/ 
Board  recommendations  are  based  not  only  on  the  consideration  of  scientific  merit  (as  judged  by  the  initial  review  groups),  but 
also  on  the  relevance  of  the  proposed  study  to  the  Institute’s  programs  and  priorities.  With  few  exceptions,  grants  caimot  be  a- 
warded  without  recommendations  for  approval  by  a Council/Board.  Councds/Boards  make  recommendations  to  Institute  staff 
on  funding.  They  also  advise  on  the  overall  program  of  the  particular  Institute  they  serve.  (See  IRG.) 

CPI  Consumer  Price  Index.  Measures  changes  in  prices  of  a broad  range  of  consumer  items.  (See  BRDPI.) 

Current  Dollars  Actual  dollars  awarded,  without  adjustment  for  inflation.  (See  Constant  Dollars.) 

DFM  Division  of  Financial  Management. 

DHHS  Department  of  Health  and  Human  Services.  A federal  executive  department  of  which  the  Pubhc  Health  Service  is  a component. 

Direct  Cost  Award  component  consisting  of  itemized  equipment,  persoimel,  travel,  and  other  expenses  necessary  to  carry  out  the  research 
proposal.  (Compare  with  Indirect  Cost,  Total  Cost) 

DRG  Division  of  Research  Grants,  NIH. 

Extramural  Awards  Funds  provided  by  the  National  Institutes  of  Health  to  organizations  outside  the  NIH.  (See  IntramuraL) 

Fellowship  An  NIH  training  program  award  in  which  an  individual  applies  to,  and  (where  appropriate)  receives  an  award  directly  from 
the  NIH.  Fellowships  comprise  the  F activity  codes.  (See  Training.) 

FIRST  Award  (R29)  First  Independent  Research  Support  and  Transition  Award.  Intended  to  provide  a sufficient  initial  period  of  research 
support  for  newly  independent  biomedical  investigators  to  develop  their  research  capabilities  and  demonstrate  the  merit  of  their 
research  ideas. 

Fiscal  Year  (FY)  The  period  estabhshed  for  government  accounting  purposes.  Fiscal  year  1993,  for  example,  started  October  1,  1992 
and  ended  September  30,  1993. 

Fiscal  Year  of  IRG  Review  The  fiscal  year  in  which  the  initial  review  groups  (IRG’s)  meet. 

Funded  Carryover  A competing  application  which  is  unfunded  at  the  end  of  a fiscal  year,  but  subsequently  (in  the  fiscal  year  imder  con- 
sideration) is  funded. 
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Grant  (award)  Funding  for  a particular  scientific  inquiry  from  one  of  the  NIH’s  institutes  or  centers. 

HBCU  Historically  Black  College  or  University.  A college  or  university  established  prior  to  1964  whose  principal  mission  was  the  educa- 
tion of  African  Americans.  Many  HBCU’s  are  located  in  the  South.  (See  Minority  Institution,  Traditionally  or  Predominantly  Afri- 
can American  bistitutiorL) 

IMPAC  (Information  for  Management,  Planning,  Analysis,  and  Coordination)  This  database  is  the  primary  source  of  information  for  this 
publication.  IMPAC  is  a computer-based  system  developed  and  maintained  by  the  NIH  Division  of  Research  Grants  for  information 
concerning  PubHc  Health  Service  extramural  programs.  (For  definitions  of  each  item  in  IMPAC,  see  IMPAC  Definitions  & 
Specifications,  Master  File,  July  1993.) 

Indirect  Cost  Award  component  provided  to  help  defray  costs  of  institutional  overhead  and  grant  administration.  The  amount  of  indirect 
cost  awarded  is  usually  derived  from  the  "indirect  cost  rate,"  a prearranged,  negotiated  percentage  of  the  direct  cost  award.  Sepa- 
rate rates  are  negotiated  with  each  institution.  Several  research  grant  mechanisms  are  not  ehgible  for  fuU  indirect  cost  reimburse- 
ment: foreign  research  grants;  conferences  (R13);  education  grants  (R25);  biomedical  research  support  grants  (S07,  SIO);  small 
instrumentation  grants  (SI 5);  research  development  grants  (SOS);  research  career  program  awards  (ICs);  minority  student  appren- 
tice program  (S03);  and  hazardous  waste  worker  health  and  safety  training  programs  (D42).  (Compare  with  Direct  Cost,  Total 
Cost) 


Institutes/Centers  NIH  Institutes,  Centers,  or  Divisions;  components  of  the  National  Institutes  of  Health  (includes  the  National  Library 
of  Medicine).  Institutes/Centers  can  make  extramural  awards.  Institutes/Centers  include: 


AA  National  Institute  on  Alcohol  Abuse  and  Alcoholism  (NIAAA) 
AG  National  Institute  on  Aging  (NIA) 

AI  National  Institute  of  Allergy  and  Infectious  Diseases  (NIAID) 
AR  National  Institute  of  Arthritis  and  Musculoskeletal  and  Skin 
Diseases  (NIAMS) 

CA  National  Cancer  Institute  (NCI) 

CL  Clinical  Center  (CLC) 

CT  Division  of  Computer  Research  and  Technology  (DCRT) 

DA  National  Institute  on  Drug  Abuse  (NIDA) 

DC  National  Institute  on  Deafness  and  Other  Communication 
Disorders  (NIDCD) 

DE  National  Institute  of  Dental  Research  (NIDR) 

DK  National  Institute  of  Diabetes  and  Digestive  and  Kidney 

Diseases  (NIDDK) 

DS  Division  of  Safety  (DS) 


ES  National  Institute  of  Environmental  Health  Sciences  (NIEHS) 
EY  National  Eye  Institute  (NEI) 

GM  National  Institute  of  General  Medical  Sciences  (NIGMS) 

HD  National  Institute  of  Child  Health  and  Human  Development 
(NICHD) 

HG  National  Center  for  Human  Genome  Research  (NCHGR) 

HL  National  Heart,  Lung  and  Blood  Institute  (NHLBI) 

LM  National  Library  of  Medicine  (NLM) 

MH  National  Institute  of  Mental  Health  (NIMH) 

NR  National  Institute  for  Nursing  Research  (NINR) 

NS  National  Institute  of  Neurological  Disorders  and  Stroke 
(NINDS) 

RG  Division  of  Research  Grants  (DRG) 

RR  National  Center  for  Research  Resources  (NCRR) 

TW  Fogarty  International  Center  (FIC) 
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Intramural  Research  conducted  by,  or  in  support  of,  employees  of  the  NIH. 

IRG  Initial  Review  Group.  The  first  level  of  a two-stage  peer  review  system.  These  legislatively  mandated  panels  of  experts  are  estab- 
lished generally  according  to  scientific  disciplines  or  organ  or  disease  areas.  Their  primary  function  is  the  review  and  rating  of 
research  grant  applications  for  scientific  and  technical  merit.  They  make  recommendations  for  appropriate  level  of  support  and 
duration  of  award.  (See  Council,  Priority  Score.) 

ISB  Information  Systems  Branch,  Division  of  Research  Grants,  NIH. 

MARC  Minority  Access  to  Research  Careers.  Program  to  provide  special  research  training  opportunities  in  the  biomedical  sciences  for 
students  and  faculty  at  4-year  colleges  and  health  professional  schools  in  which  substantial  student  enrollments  are  dravm  from 
minority  groups. 

MBRS  Minority  Biomedical  Research  Support.  Program  to  strengthen  the  biomedical  research  and  research  training  capabihty  of  ethnic 
minority  institutions,  and  thus  establish  a more  favorable  miheu  for  increasing  the  involvement  of  minority  faculty  and  students 
in  biomedical  research. 

Mechanism  Also  known  as  Activity  Code. 

MERIT  Award  (R37)  Method  to  Extend  Research  In  Time  Award.  Designed  to  provide  long-term  support  to  investigators  whose  research 
competence  and  productivity  are  distinctly  superior  and  who  are  highly  Likely  to  continue  to  perform  in  an  outstanding  manner. 
Investigators  may  not  apply  for  a MERIT  award.  Candidates  are  identified  for  the  MERIT  award  during  the  course  of  review  of 
competing  research  grant  applications  prepared  and  submitted  in  accordance  with  regular  PHS  requirements. 

Minority  Institution  Institutions  which  draw  a substantial  share  of  its  enrollments  from  minorities.  They  include  institutions  with  a tradi- 
tionally high  (more  than  50  percent)  minority  enrollment,  and  those  with  a significant  proportion  of  students  derived  from  ethnic 
minorities  (but  not  necessarily  more  than  50  percent)  and  recognized  by  the  Secretary  of  DHHS  as  having  demonstrated  a commit- 
ment to  the  special  encouragement  or  assistance  of  minority  students  and  faculty.  (See  HBCU,  Traditionally  or  Predominantly 
African  American  Institution.) 

Minority  Targeted  Grant  Program  An  NIH  program  available  to  members  of  minority  groups  and  to  minority  institutions.  The  aim  is 
to  benefit  minorities,  even  if  individual  grants  go  to  nonminorities. 

New  (application,  award,  grant)  Refers  to  an  application  which  has  not  received  prior  funding.  (Compare  with  Competing  Continuation, 
Noncompeting  Continuation,  Supplement) 
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NIH  National  Institutes  of  Health 

NIH/OD  National  Institutes  of  Health,  Office  of  the  Director 

Noncompeting  Continuation  A year  of  continued  support  for  an  existing  grant  that  had  been  funded  previously.  Apphcations  for  this 
continued  support  do  not  undergo  peer  review,  but  are  administratively  reviewed  by  the  Institute/Center  and  receive  an  award 
based  on  prior  award  commitments.  (See  New,  Competing  Continuation,  Supplement) 

NRFC  Not  Recommended  for  Further  Consideration.  Starting  in  FY  1992,  as  a result  of  study  section  review,  an  appHcation  may  be  con- 
sidered not  recommended  for  further  consideration  if  it  does  not  have  "significant  and  substantial  merit."  This  is  a broader  cate- 
gory than  "disapproval,"  a term  which  is  no  longer  used. 

NRSA  National  Research  Service  Award.  Includes  awards  to  both  individuals  and  institutions  to  provide  research  training  in  specified 
health  related  areas. 

Other  Research  Grants  AU  research  grants  not  coded  as  research  projects  or  research  centers.  (See  Research  Projects,  Research  Centers.) 

Percentile  Rank  Percentile  rank  of  a particular  appHcation  is  the  percent  of  these  apphcations  with  equal  or  better  scores  than  the  particu- 
lar appHcation.  An  appHcation  is  usuaUy  percentiled  against  the  apphcations  reviewed  within  its  own  study  section  in  three  con- 
secutive meetings.  (See  Percentiling,  Priority  Score.) 

Percentiling  The  statistical  mechanism  that,  since  the  October  1988  Advisory  Council  round,  has  been  the  major  determinant  of  the  fund- 
ing decisions  of  aU  institutes.  Each  study  section’s  apphcations  that  are  recommended  for  further  consideration  are  ranked  in  per- 
centiles according  to  priority  score.  As  with  priority  scores,  the  lower  the  numerical  value,  the  greater  the  merit  of  the  appHcation. 
A basic  assumption  of  percentihng  is  that  the  quahty  of  reviewed  apphcations  is  roughly  equivalent  among  aU  study  sections. 
(See  Percentile  Rank,  Priority  Score.) 

PHS  U.S.  Pubhc  Health  Service,  which  is  part  of  the  Department  of  Health  and  Human  Services.  NIH  is  the  largest  agency  within  the 
PHS. 

Principal  Investigator  The  individual  who  is  responsible  for  the  scientific  and  technical  direction  of  a project  and  in  whose  name  the  grant 
appHcation  is  submitted. 
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Priority  Score  A priority  score  is  assigned  to  an  application  that  is  recommended  for  further  consideration  by  an  initial  review  group 
(IRG).  The  score  is  a quantitative  indicator  of  scientific  and  technical  merit  that  ranges  from  100  to  500.  Individual  IRG  members 
assign  scores  from  1.0  (highest  merit)  to  5.0  (lowest  merit).  Under  laws  governing  NIH’s  chartered  advisory  committees,  only  regu- 
lar members  or  members  of  the  NIH  Reviewers  Reserve  (not  ad  hoc  consultants)  are  permitted  to  vote  on  apphcation  quahty.  Votes 
were  cast  in  0.5  intervals  untU.  1980.  Since  then,  in  order  to  achieve  more  precise  scoring,  votes  have  been  cast  in  0.1  intervals. 
The  three-digit  priority  scores  are  the  average  of  member  votes  multiphed  by  100.  (See  IRG.) 

Race/Ethnic  Origin  The  category  that  most  closely  reflects  the  individual’s  recognition  in  the  conununity  should  be  used  for  purposes 
of  reporting  mixed  racial  and/or  ethnic  origins. 

Native  American  is  a person  having  origins  in  any  of  the  original  peoples  of  North  America,  and  who  maintains  a cultural 
identification  through  tribal  affiliation  or  community.  (PHS  Form  398  identifies  these  as  American  Indian  or  Alaskan  Na- 
tive.) 

Asian  or  Pacific  Islander  is  a person  having  origins  in  any  of  the  peoples  of  the  Far  East,  Southeast  Asia,  and  the  Indian 
subcontinent  or  the  Pacific  Islands.  This  area  includes,  for  example,  China,  India,  Japan,  Korea,  the  Phihppine  Islands, 
and  Samoa. 

African  American  is  a person  having  origins  in  any  of  the  black  racial  groups  of  Africa.  (PHS  Form  398  identifies  as 
Black.) 

Hispanic  is  a person  of  Mexican,  Puerto  Rican,  Cuban,  Central  or  South  American,  or  other  Spanish  culture  or  origin,  re- 
gardless of  race. 

White,  not  of  Hispanic  origin  is  a person  having  origins  in  any  of  the  original  peoples  of  Europe,  North  Africa,  or  the  Mid- 
dle East. 

The  term  "Underrepresented  Minorities"  is  used  to  describe  those  who  are  in  smaller  number  in  the  biomedical  sciences 
than  would  be  their  proportion  in  the  general  population.  These  include  African  Americans,  Hispanics,  and  Native  Ameri- 
cans. 
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Renewal  See  Competing  ContinuatioiL 

Research  Centers  Research  center  grants  support  multidisciplinary,  long-term  research  and  development  programs  at  research  centers. 
Research  centers  usually  have  a cUnical  orientation  and  include  all  P activities  (excluding  NLM  for  all  years  and  NCNR  for  FY 
1986)  that  are  not  included  in  research  projects;  aU  M activities;  selected  U activities  (U40,  U41,  U42,  U54);  R07  and  G12. 

Research  Grants  Extramural  awards  made  for  Research  Projects,  Research  Centers,  and  Other  Research  Grants. 

Research  Projects  (RPG)  Primarily  investigator-initiated,  basic  scientific  research.  Activity  codes  for  research  projects  in  FY  1993  are  as 
follows:  ROl,  R29,  R35,  R37,  R43,  R44,  R55,  POl,  P42,  UOl,  U19,  U43.  Excludes  NCRR  for  fiscal  years  prior  to  FY  1990,  NLM 
for  aU  years,  NCNR  for  FY  1986,  and  UOl  for  FYs  1980  and  1981.  For  definitions  of  these  codes,  see  Activity  Codes,  Organization 
Codes,  and  Definitions  Used  in  Extramural  Programs,  January  1994,  NIH  Manual  Issuance  4101/6304-2. 

Review  The  dual-level  examination  of  an  application  for  scientific  merit  and  program  relevance.  (See  IRG,  CoundL) 

RPG  Research  Project  Grant.  (See  Research  Projects.) 

SAES  Statistics,  Analysis  and  Evaluation  Section,  Information  Systems  Branch,  Division  of  Research  Grants,  NIH. 

SBIR  Award  (R43,  R44,  U43,  U44,  N43,  N44)  Small  Business  Innovation  Research  Award.  Designed  to  support  projects  that  may  ulti- 
mately have  commercial  viability. 

Study  Section  An  Initial  Review  Group  (IRG)  that  is  within  the  Division  of  Research  Grants  (DRG). 

Success  Rate  The  percentage  of  reviewed  applications  that  receive  funding.  It  is  computed  by  dividing  the  number  of  competing  applica- 
tions funded  by  the  sum  of:  (1)  total  number  of  competing  applications  reviewed,  (2)  number  of  funded  carryovers,  (3)  number 
of  applications  eliminated  during  triage.  Applications  that  have  one  or  more  amendments  in  the  same  fiscal  year  are  counted  only 
once  in  success  rate  computation.  (See  Funded  Carryover,  Triage.) 

Supplement  A request  for  additional  funds  either  for  the  current  operating  year  or  for  any  future  year  previously  recommended.  A sup- 
plement can  be  either  noncompeting  (administrative)  or  competing  (subject  to  peer  review). 

Total  Cost  The  sum  of  the  Direct  Cost  plus  the  Indirect  Cost 

Traditional  Research  Project  Grant  (ROl)  Intended  to  support  a discrete,  specified,  circumscribed  project  to  be  performed  by  the  named 
investigator(s)  in  an  area  representing  their  specific  interest  and  competencies. 


123 


^pendices 

Glossary  of  Terms 

Traditionally  or  Predommantiy  African  American  Institution  An  institution  with  a significant  African  American  poptilation.  These  institu- 
tions are  ehgible  for  MARC  and  MBRS  programs.  (See  HBCU.) 

Training  Training  awards  support  the  research  training  of  scientists  for  careers  in  the  behavioral  and  biomedical  sciences.  Training  awards 
consist  of  institutional  training  grants  (T  mechanisms)  and  individual  fellowships  (F  mechanisms). 

Triage  The  process  of  eliminating  from  review  those  applications  submitted  in  answer  to  a request  for  application  (RFA)  which  were 
judged  to  be  of  noncompetitive  quahty. 
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DRG  Chartered  Study  Sections. 

Competing  R,  P,  and  U applications  (excluding  R13,  R15,  R43,  R44,  R55,  U43,  and  U44  activities)  reviewed  by  chartered 
DRG  Study  Sections  are  percentiled  against  their  own  base  if  they  have  met  the  qualifications  described  on  page  103.  The 
base  includes  appHcations  reviewed  in  the  current  and  prior  two  meetings.  It  also  includes  any  apphcations  reviewed  by 
ad  hoc,  SEP  or  special  study  sections  which  have  designated  a parent  study  section  in  the  prior  rounds. 

DRG  Ad  Hoc,  SEP,  and  Special  Study  Sections  with  Parent  Committee  Designations. 

Competing  R,  P,  and  U apphcations  (excluding  R13,  R15,  R43,  R44,  R55,  U43,  and  U44  activities)  reviewed  by  ad  hoc 
and  special  study  sections  (SSS)  where  at  least  30  percent  of  the  members  are  currently  serving  on  a chartered  committee 
or  have  served  within  the  last  two  years  will  be  percentQed  using  the  designated  chartered  study  section’s  base  or  past 
round  base  if  the  current  base  has  not  been  computed.  In  future  rounds  these  apphcations  whl  be  included  in  the  base 
for  that  chartered  study  section.  If  a research  apphcation  is  reviewed  as  a fehowship  by  an  ad  hoc  study  section  and  the 
parent  committee  designation  is  a fehowship  committee  the  percentile  wQl  be  based  on  the  "Total  DRG"  table. 

DRG  Ad  Hoc  and  Special  Study  Sections  Without  Parent  Committee  Designations  (Excluding  ARRA-ARRG  Study  Sections). 
Competing  R,  P,  and  U apphcations  (excluding  R15,  R43,  R44,  R55,  U43,  and  U44  activities)  reviewed  by  ad  hoc  and  spe- 
cial study  sections  (SSS)  that  have  not  indicated  a parent  committee  are  percentiled  against  the  "Total  DRG"  base.  The 
base  is  comprised  of  ah  competing  apphcations  reviewed  in  the  prior  three  council  rounds  by  chartered  DRG  study  sections 
meeting  the  qualification  requirement  in  the  immediate  past  round.  Apphcations  reviewed  by  DRG  ad  hoc  or  special  study 
sections  which  have  designated  a parent  committee  in  the  prior  three  rounds  are  also  included. 

Applications  Reviewed  by  AIDS-Related  Research  (ARRA-ARRG  Study  Sections)  at  Ad  Hoc  Meetings  Without  Parent 

Committee  Designations.  Competing  R,  P,  and  U apphcations  (excluding  R13,  R15,  R43,  R44,  R55,  U43,  and  U44) 
reviewed  by  ARRA-ARRG  study  sections  at  ad  hoc  meetings  (or  where  the  ARR  study  section  is  not  deemed  "qualified") 
are  percentiled  against  a separate  "AIDS  Total  Table".  This  table  is  constructed  from  ah  R,  P,  and  U (excluding  R13,  R15, 
R43,  R44,  R55,  U43,  and  U44)  apphcations  which  have  been  reviewed  by  chartered  ARR  study  sections  in  the  prior  three 
(3)  council  rounds  and  have  met  the  qualification  criteria  in  the  past  round. 
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DRG-Reviewed  Fellowship  Applications. 

Competing  fellowship  (F)  applications  reviewed  by  chartered  DRG  study  sections  are  percentiled  using  the  same  criteria 
and  formula  as  the  study  sections  reviewing  research  grants.  Likewise,  the  fellowship  applications  reviewed  at  ad  hoc 
meetings  of  DRG  study  sections  are  percentiled  against  a "Total  Fellowship"  table  which  is  built  using  the  same  methodolo- 
gy as  the  "Total  DRG"  table.  The  option  of  percentiling  an  ad  hoc  meeting  against  a chartered  study  section  is  appHcable 
for  fellowship  applications  as  it  is  for  research  grants.  In  cases  where  a fellowship  application  is  reviewed  by  an  ad  hoc 
meeting  of  a non-feUowship  study  section  and  the  parent  committee  is  a non-fellowship  committee  the  percentile  wfll  be 
derived  from  the  "Total  Fellowship"  table. 

Applications  Reviewed  by  ARRA-ARRG  Study  Sections  at  Ad  Hoc  Meetings. 

Competing  R,  P,  and  U appHcations  (excluding  R13,  R15,  R43,  R44,  R55,  U43,  and  U44  activities)  reviewed  by  ARRA  - 
ARRG  study  sections  at  ad  hoc  meetings  (or  where  the  ARR  study  section  is  not  deemed  "qualified")  are  percentiled  against 
a separate  "AIDS  Total  Table".  This  table  is  constructed  from  all  R,  P,  and  U (excluding  R13,  R15,  R43,  R44,  R55,  U43, 
and  U44)  appHcations  which  have  been  reviewed  by  chartered  ARR  study  sections  in  the  prior  three  (3)  council  rounds 
and  have  met  the  qualification  criteria  in  the  past  round. 

NIH  Institute! Center  Reviewed  Competing  Applications  (Excluding  NCRR). 

Competing  R,  P,  and  U appHcations  (excluding  R13,  R15,  R43,  R44,  R55,  U43,  and  U44  activities)  reviewed  by  an  Institute 
or  Center  (other  than  NCI)  initial  review  group  are  percentiled  using  the  "Total  DRG"  table.  AppHcations  reviewed  by  NCI 
IRG’s  are  not  percentiled  against  the  "Total  DRG"  table. 

NCRR  Reviewed  Applications. 

Competing  R,  P,  U,  and  MOl  appHcations  (excluding  R13,  R15,  R43,  R44,  R55,  U43,  and  U44)  reviewed  by  NCRR  chart- 
ered committees  are  percentiled  using  the  grant  history  for  their  committee  as  long  as  they  have  met  the  qualification  re- 
quirements. If  the  committee  has  not  reviewed  25  appHcations  in  the  current  and  prior  2 rounds  then  the  appHcation  is 
percentiled  using  the  "Total  DRG"  table. 
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Bases  Used  for  Percentiling 

NIAAA,  NIDA  and  NIMH  Chartered  Initial  Review  Groups. 

Competing  R,  P,  and  U applications  reviewed  by  chartered  NIAAA,  NIDA,  and  NIMH  IRG’s  are  percentiled  using  the  same 
methodology  as  the  DRG  study  sections  with  minor  differences.  The  differences  are:  (1)  applications  submitted  in  re- 
sponse to  an  RFA  are  excluded  from  percentiling;  and  (2)  RIO  and  R13  apphcations  are  excluded  from  the  base  for  per- 
centOing  (they  do,  however,  receive  a percentile  based  on  the  institute  "Total"  table  described  below. 

NIAAA,  NIDA,  and  NIMH  Special  Review  Committees  and  Non-Qualified  Chartered  IRG’s. 

A "Total"  percentile  table  is  constructed  for  each  Institute.  The  "Total  Table"  is  built  from  aU  R,  P,  and  U applications 
(excluding  R13,  R15,  R43,  R44,  R55,  and  all  applications  submitted  in  response  to  an  RFA)  that  have  been  reviewed  in 
the  prior  three  council  rounds  by  the  institutes’  chartered  IRG’s  that  are  qualified  in  the  immediately  prior  council  cycle. 
Applications  given  ad  hoc  reviews  (AHR’s)  which  designate  a parent  committee  in  the  prior  three  rounds  are  also  included. 
AU  special  reviews  that  are  done  (other  than  those  meeting  the  30%  of  current/former  IRG  members)  use  this  table  for 
assigning  the  percentile. 

Agency  for  Health  Care  Policy  and  Research  (AHCPR). 

Competing  R,  P,  and  U appUcations  (excluding  R03  (if  score  is  000),  R13,  R15,  R43,  R44,  R55,  U43,  and  U44)  are  per- 
centiled using  the  chartered  committee’s  base  of  records  for  the  current  and  prior  two  rounds.  If  a committee  does  not 
meet  the  "qualification"  requirements,  then  it  is  percentiled  against  the  "Total  DRG"  table. 

Center  for  Substance  Abuse  Prevention  (CSAP),  SAMHSA. 

Competing  appUcations  assigned  to  CSAP  IRG’s  are  percentiled  by  group  code  using  only  those  appUcations  reviewed  in 
the  current  councU  cycle.  Each  meeting  held  by  the  Special  Review  Committee  on  Substance  Abuse  Prevention  Conference 
Review  Committee  is  percentiled  on  its  own. 
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Minority-Targeted  Grant  Activities 


G12  Research  Center  in  Minority  Institutions  Award 

To  assist  predominantly  minority  institutions  that  offer  a doctorate  in  the  health  professions  and/or  health-related  sciences  to 
strengthen  and  augment  their  human  and  physical  resources  for  the  conduct  of  biomedical  research. 

K14  Minority  School  Faculty  Development  Awards 

To  encourage  the  development  of  faculty  investigators  at  minority  schools  and  to  enhance  their  research  capabihties  in  specified 
health  and  health-related  areas. 

S03  Minority  High  School  Student  Research  Apprentice  Program 

To  provide  meaningful  experience  in  various  aspects  of  health-related  research  in  the  expectation  that  some  apprentices  will  decide 
to  pursue  careers  in  biomedical  research. 

S06  Minority  Biomedical  Research  Support  (MBRS) 

To  strengthen  the  biomedical  research  and  research  training  capability  of  minority  institutions,  and  thus  increase  the  involvement 
of  minority  faculty  and  students  in  biomedical  research. 

Sll  Minority  Biomedical  Research  Support  (MBRS)  Thematic  Project  Grants 

To  promote  increased  faculty  and  interdepartmental  collaboration  through  programs  that  focus  on  specific  research  themes  or  sci- 
entific disciplines  at  developing  minority  institutions.  These  grants  are  intended  to  strengthen  the  biomedical  research  capabihty 
in  defined  areas  and  to  attract  other  competent  biomedical  scientists  by  improving  the  research  environment. 

SI 4 Minority  Biomedical  Research  Support  (MBRS)  Grant  Program  for  Undergraduate  Colleges 

To  enrich  the  research  environment  at  ehgible  undergraduate  institutions  with  the  purposes  of  motivating  students  toward 
biomedical  research  careers,  and  providing  faculty  with  opportunities  to  participate  in  biomedical  research. 
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Minority-Targeted  Grant  Activities 


F34  MARC  NRSA  Faculty  Fellowships 

To  provide  fellowships  to  selected  faculty  members  from  minority  institutions  to  enable  them  to  obtain  advanced  training  in 
specified  health  and  health-related  areas. 

F36  MARC  Visiting  Scientists  Fellowships 

To  strengthen  research  and  teaching  programs  in  the  biomedical  sciences  for  the  benefit  of  students  and  faculty  at  minority 
institutions  by  drawing  upon  the  special  talents  of  scientists  from  other  institutions. 

T34  MARC  Undergraduate  NRSA  Institutional  Grants 

To  enable  minority  institutions  to  make  to  individuals  selected  by  them,  National  Research  Service  Awards  for  undergraduate 
research  training  in  the  biomedical  and  behavioral  sciences. 

T36  MARC  Ancillary  Training  Activities  (Grant) 

To  increase  the  number  of  weU-trained  minority  scientists  in  biomedical  disciplines  and  to  strengthen  the  research  and  teaching 
capabilities  of  minority  institutions  through  a variety  of  training  mechanisms  such  as  visits  by  experienced  scientists  to  minority 
institutions  or  workshops/conferences  designed  to  enhance  the  research  training  experience  of  students/faculty  from  minority  insti- 
tutions. 
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Definitioiis  of  Selected  Grant  Activities 


KOI  Research  Scientist  Development  Award  — Research  & Training 

For  support  of  a scientist,  committed  to  research,  in  need  of  both  advanced  research  training  and  additional  experience. 

K04  Research  Career  Development  Awards 

To  foster  the  development  of  young  scientists  with  outstanding  research  potential  for  careers  of  independent  research  in  the 
sciences  related  to  health.  This  appHes  only  when  the  appUcation  for  the  initial  award  was  received  after  July  1,  1967. 

POl  Research  Program  Projects 

For  the  support  of  a broadly  based,  multidisciplinary,  often  long-term  research  program  that  has  a specific  major  objective  or  a 
basic  theme.  A program  project  generally  involves  the  organized  efforts  of  relatively  large  groups,  members  of  which  are  conduct- 
ing research  projects  designed  to  elucidate  the  various  aspects  or  components  of  this  objective.  Each  research  project  is  usually 
under  the  leadership  of  an  estabhshed  investigator.  The  grant  can  provide  support  for  certain  basic  clinical  components,  the  shar- 
ing of  which  facihtates  the  total  research  effort.  A program  project  is  directed  toward  a range  of  problems  having  a central  re- 
search focus  in  contrast  to  the  usually  narrower  thrust  of  the  traditional  research  project.  Each  project  supported  through  this 
mechanism  should  contribute  or  be  directly  related  to  the  common  theme  of  the  total  research  effort;  these  scientifically  meritori- 
ous projects  should  demonstrate  an  essential  element  of  unity  and  interdependence;  i.e.,  a system  of  research  activities  and  projects 
directed  toward  a weU-defined  research  program  goal. 

ROl  Research  Project  (Traditional) 

To  support  a discrete,  specified,  circumscribed  project  to  be  performed  by  the  named  investigator (s)  in  an  area  representing  his 
specific  interest  and  competencies. 

R13  Conference 

To  support  international  or  national  meetings,  conferences,  and  workshops. 

R15  Academic  Research  Enhancement  Awards  (AREA) 

To  support  small-scale  research  projects  conducted  by  faculty  in  primarily  baccalaureate-granting  institutions.  Awards  are  for  up 
to  $100,000  for  up  to  a 24-month  period. 
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Definitions  of  Selected  Giant  Activities 


R22  U.S.-Japan  Cooperative  Medical  Science  Program 

To  support  research,  for  the  benefit  of  the  people  of  Asia,  confined  to  six  specifically  limited  medical  problem  areas:  cholera,  lepro- 
sy, mahiutiition,  the  parasitic  diseases  schistosomiasis  and  filariasis,  tuberculosis,  and  certain  viral  diseases  (primarily  rabies  and 
dengue  hemorrhagic  fever).  Program  emphasis  is  upon  medical  research  as  the  basis  for  advanced  knowledge  necessary  for  effec- 
tive action. 

R23  New  Investigator  Research  Awards 

To  support  basic  and  clinical  studies  so  that  newly  trained  investigators  remain  active  during  the  developmental  stages  of  their 
careers. 

R29  First  Independent  Research  Support  and  Transition  (FIRST)  Awards 

To  provide  a sufficient  initial  period  of  research  support  for  newly  independent  biomedical  investigators  to  develop  their  research 
capabilities  and  demonstrate  the  merit  of  their  research  ideas. 

R43  Small  Business  Innovation  Research  Grants  (SBIR)  — Phase  I 

To  support  projects,  limited  in  time  and  amount,  to  estabhsh  the  technical  merit  and  feasibility  of  research  and  development 
(R&D)  ideas  that  may  ultimately  lead  to  a commercial  product(s)  or  service  (s). 

R44  Small  Business  Innovation  Research  Grants  (SBIR)  - Phase  II 

To  support  in-depth  development  of  R&D  ideas  whose  feasibility  has  been  estabhshed  in  Phase  I and  are  likely  to  result  in  com- 
mercial products  or  services. 

SIO  Biomedical  Research  Support  Shared  Instrumentation  Grants 

To  make  available  to  institutions  with  a high  concentration  of  NIH  extramural  research  awards,  research  instruments  for  shared 
use. 
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Other  Publications  of  Interest 


NIH  PEER  REVIEW  NOTES 

Information  on  DRG  and  Institute  peer  review  policies  and  procedures  published  periodically  (usually  prior  to  scientific  review 
meetings)  for  NIH  consultants  and  staff. 

DRG  PEER  REVIEW  TRENDS:  CHARACTERISTICS  OF  MEMBERS  OF  DRG  STUDY  SECTIONS,  INSTITUTE  REVIEW 
GROUPS,  AND  ADVISORY  COUNCILS,  I98I-I99I 

Charts  and  commentary  describing  10-year  trends  in  the  characteristics  of  NIH  peer  reviewers. 

NIH  NEW  GRANTS  AND  AWARDS 

Quarterly  Hst  of  new  awards  arranged  by  grant  mechanism  and  by  state,  city,  institution,  and  principal  investigator;  includes  title, 
grant  number,  and  dollars  awarded.  These  data  vtiU  be  available  through  an  electronic  bulletin  board.  For  information  regarding 
their  access,  please  contact  Ms.  Carolyn  SteUe  of  the  Data  Management  and  Control  Section,  Information  Systems  Branch,  Division 
of  Research  Grants,  National  Institutes  of  Health,  Bethesda,  Maryland  20892.  She  can  be  reached  at  301/594-7015  (voice), 
301/594-7058  (facsimile),  or  WUS@NIHCU.GOV  (E-Mail). 

NIH  EXTRAMURAL  TRENDS,  FISCAL  YEARS  1984-1993 

Annual  series  of  charts  and  commentary  describing  10-year  trends  in  NIH  extramural  awards;  released  annually. 

WOMEN  IN  NIH  EXTRAMURAL  GRANT  PROGRAMS,  FY  84-93 

Charts  and  commentary  describing  10-year  trends  in  NIH  peer  review  and  funding  arranged  by  gender  of  applicant. 

MINORITIES  IN  NIH  EXTRAMURAL  GRANT  PROGRAMS,  FY  82-91 

Charts  and  commentary  describing  10-year  trends  in  NIH  peer  review  and  funding  arranged  by  racial/ethnic  group  of  apphcant. 

For  other  DRG  pubhcations  such  as  program  guidelines,  grantsmanship  articles  and  brochures,  and  pubhcations  explaining  the  NIH 
extramural  programs,  contact  the  Grants  Information  Office,  Division  of  Research  Grants,  NIH,  Westwood  Building,  Room  449,  Bethesda, 
Maryland  20892  or  telephone  (301)  594-7248. 
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